cloud

Hadoop safemode recovery - taking lot of time

六眼飞鱼酱① 提交于 2019-12-06 22:16:34
We are running our cluster on Amazon EC2. we are using cloudera scripts to setup hadoop. On the master node, we start below services. 609 $AS_HADOOP '"$HADOOP_HOME"/bin/hadoop-daemon.sh start namenode' 610 $AS_HADOOP '"$HADOOP_HOME"/bin/hadoop-daemon.sh start secondarynamenode' 611 $AS_HADOOP '"$HADOOP_HOME"/bin/hadoop-daemon.sh start jobtracker' 612 613 $AS_HADOOP '"$HADOOP_HOME"/bin/hadoop dfsadmin -safemode wait' On the slave machine, we run the below services. 625 $AS_HADOOP '"$HADOOP_HOME"/bin/hadoop-daemon.sh start datanode' 626 $AS_HADOOP '"$HADOOP_HOME"/bin/hadoop-daemon.sh start

Terraform - should I use user_data or provisioner to bootstrap a resource?

点点圈 提交于 2019-12-06 21:19:10
问题 It seems like I can use either user_data with a template file or a "remote-exec" provisioner with inline commands to bootstrap. So which one is considered more idiomatic? 回答1: You should use user_data . The user data field is idiomatic because it's native to AWS, whereas the remote-exec provisioner is specific to Terraform, which is just one of many ways to call the AWS API. Also, the user-data is viewable in the AWS console, and often an important part of using Auto Scaling Groups in AWS,

Upload image to Cloudinary using PHP Codeigniter

江枫思渺然 提交于 2019-12-06 18:08:17
问题 Can someone help me how to upload an image into Cloudninary using CodeIgniter? I don't know how to install the Cloudinary to CodeIgniter and use it because I'm new to PHP CodeIgniter. Please help me thank you. Update! I was able to solve it. See the first answer. cheers 回答1: First You need to download the cloudinary php script here https://github.com/cloudinary/cloudinary_php. Now extract the downloaded file and copy the files from src folder. Now in you codeigniter app, go to appplication

【CF 应用开发大赛】享途网,社交化旅游分享平台

一世执手 提交于 2019-12-06 16:58:33
应用名称 :享途网 应用URL : http://sharetour.cloudfoundry.com/ 应用说明及使用场景 : 享途网是一个社交化的旅游经历分享平台,将旅游经历社交化,它不同于大型网站广告式的攻略发布, 而是汇集驴友们的亲身感受,为即将出游的人提供更加可信的旅游经验分享。同时享途网加入了同城信息, 在欣赏驴友们精彩的旅行经历的同时,你还可以看看本地人是怎么评价当地景点的,为你的出行做好最充分 的准备。 应用所使用的技术及软件: 前端:Bootstrap, jQuery 后端采用基本的J2EE,Servlet+JSP,未用框架(其实还没怎么学~ XD),数据库使用MySQl,图片存储在MongoDB里,等有机会的话再试用一下云存储吧,所以读取速度比较慢,加载的时候可能会有点儿吃力。 创新亮点 : 享途网的创新之处在于 社会化+游记+同城评论 享途网在以往旅游攻略类网站的思路上加上社会化的功能,如分享,评论,like等,同时加入了同城评论的功能(尽管这一功能还处于开发阶段),也就是说生活在景区附近城市的人可以对景点给出当地人的评价(比如说推荐哪家的菜好吃又实惠等等),这样对初来乍到的旅游者来说提供了更加可信的旅游信息。将游记社交化的目的 就是为游客提供尽可能真实的旅游指导。 考试前报的名,考完试这几天才开始做,感觉时间有点紧,大体功能已经差不多了

can HBase , MapReduce and HDFS can work on a single machine having Hadoop installed and running on it?

二次信任 提交于 2019-12-06 16:56:20
I am working on a search engine design, which is to be run on cloud. We have just started, and have not much idea about Hdoop. Can anyone tell if HBase , MapReduce and HDFS can work on a single machine having Hdoop installed and running on it ? Yes you can. You can even create a Virtual Machine and run it on there on a single "computer" (which is what I have :) ). The key is to simply install Hadoop in " Pseudo Distributed Mode " which is even described in the Hadoop Quickstart . If you use the Cloudera distribution they have even created the configs needed for that in an RPM. Look here for

How do UserSecrets work in the Cloud?

我是研究僧i 提交于 2019-12-06 16:19:06
ASP.NET Core has a great feature to store user settings securely . It works great on OSX (and Linux, Windows), stores data in JSON: ~/.microsoft/usersecrets/<userSecretsId>/secrets.json Is it working in the cloud (Cloud Foundry) too? If yes, then were are the values stored? Secrets exists for safe storage during development by helping prevent sensitive data from being storing in code / checked into source control. The Secret Manager tool does not encrypt the stored secrets and should not be treated as a trusted store. It is for development purposes only. The keys and values are stored in a

Developing a Multitenant SaaS

狂风中的少年 提交于 2019-12-06 16:13:19
问题 I am developing a web application for data analysis on agricultural datasets. Actually I want to make the application to be multi tenant and I wish to deploy that SaaS application in a private cloud (in our school). I got a few basic doubt in the programming part. Do I need to develop the application in the Hadoop's map/reduce functionality? Secondly,the selection of database. Since the data are highly structural in nature (like sql) can I use a sql server to manage data in cloud? In such do

【Cloud Foundry 应用开发大赛】“Url2Sql”后端是前端的MySql

ぐ巨炮叔叔 提交于 2019-12-06 15:47:45
应用名称:Url2Sql 应用URL地址: http://url2sql.cloudfoundry.com/root/index 应用说明: web开发的本质是把URL转化为Sql。 本应用就是把复杂的后台代码转变为web页面可视化操作完成的工作。举例说,请求形如 http://www.oschina.net/news/36941 的链接背后可能只是完成了一条形如 select * from news where id=36941 的Sql。既然如此,为何每次要用笨重的IDE完成呢? 通过web配置可以生成三种URL *, *.json, *.jsonp , http://*.json 是纯JSON数据接口,可web、手机等不同形态终端使用(跨设备)。 http://*.jsonp 是针对jQuery跨域的实现,方便调试或前后端独立并行开发。 http://*(不包含.) 则是访问HTML的,算是 Bigpipe 思想的一种实现吧。 使用场景: 简化后台开发,专注于离用户最近的前端,提升竞争力。 在线IDE,更低的门槛,可以在线完成后端,前端HTML/CSS/JS完全可以实现。 跨设备,意味着适合不同的开发者。 运行流程图: 应用所使用的技术及软件: Java(Servlet) Rhino 实现Java执行Javascript的能力 fastjson

Cloud Mangement for Amazon IaaS

扶醉桌前 提交于 2019-12-06 15:41:54
I am planning to migrate few products on Cloud which will be used as a platform for the developer community. In short I am trying to host PaaS vendor for my products which can be consumed by developers for build and development process. The plan is as below: I am trying to use Amazon IaaS ( S3, EC2) as the hardware. I will require a cloud management software which can be installed somewhere on one of my local systems and can manage the Amazon cloud. I will deploy all my products on the Amazon Cloud with the help of the Cloud Management Software. I will develop and provide APIs to my end users

socket.io over multiple servers w/o redis

孤人 提交于 2019-12-06 15:26:08
my api endpoints are spread over multiple servers over multiple locations and i am trying to figure out how to deal with socket updates on connected clients. i would really like to avoid having a single redis db setup just to handle the connected clients over the many servers. i wont have to broadcast messages, socket messages will always be sent to a single user. while i know each connected clients channel id i am not sure if its possible to just emit a message to a single user when i just have the channel id in my hand and for example the initial connection was made with another server in