scalability

Just how scalable is Grails?

旧城冷巷雨未停 提交于 2019-12-04 02:09:32
I'm looking to make a website that will probably get some heavy, repetitive traffic. Is grails up to the task? I agree with lael, also because it's built on java technologies there are a lot of proven clustering and 'enterprisey' tools available which allow you to easily scale across multiple application services. The cloud tools around Grails are also becoming very good and make deploying to a cloud like EC2 very easy. I've recently been using Cloud Foundry and found it very good. As the first poster points out however, you can write a badly performing application in any framework/language.

Distributed version control for HUGE projects - is it feasible?

若如初见. 提交于 2019-12-04 01:49:46
We're pretty happy with SVN right now, but Joel's tutorial intrigued me. So I was wondering - would it be feasible in our situation too? The thing is - our SVN repository is HUGE. The software itself has a 15 years old legacy and has survived several different source control systems already. There are over 68,000 revisions (changesets), the source itself takes up over 100MB and I cant even begin to guess how many GB the whole repository consumes. The problem then is simple - a clone of the whole repository would probably take ages to make, and would consume far more space on the drive that is

Using Rails as a framework for a large website

萝らか妹 提交于 2019-12-03 20:59:40
I've been playing around with Rails (version 3) for a few months now and I understand the framework fairly well. However, I have yet to develop a large website which offers lots of database access and user interaction. I'm fairly skeptical of the following: The Speed and Scalability of Ruby (I've heard that its up to 10 times slower than most other server-side languages). The extra background processing that Rails as a framework (multiple levels of abstration). The lack of enterprise-level web apps that run on Rails (the only ones that I can think of Groupon, Github and Hulu). The complexity

How to improve PHP performance?

那年仲夏 提交于 2019-12-03 20:21:04
I've created PHP application for Facebook. It uses MySQL, Memcached and works on Lighttpd on Centos 2,6 Ghz and 2 GB RAM. it's basically one PHP file that after first run is cached and every next time it's served in 0,8 ms directly from Memcached. What more can I do to shorten this time? Once you get to 0.8 ms, I'm not sure you can go any lower. However, you can set up multiple servers to handle many concurrent requests (with a common memcached). You will then be able to scale very high by simply adding a new server when you reach limits. Run XDebug and run the profiler . There you can see if

Websockets and scalability

落爺英雄遲暮 提交于 2019-12-03 18:42:15
问题 Am a beginner with websockets. Have a need in my application where server needs to notify clients when something changes and am planning to use websockets. 1) Single server instance and single client ==> How many websockets will be created and how many connections to websockets? 2) Single server instance and 10 clients ==> How many websockets will be created and how many connections to websockets? 3) Single server instance and 1000 clients ==> How many websockets will be created and how many

Parallel code bad scalability

江枫思渺然 提交于 2019-12-03 16:11:18
Recently I've been analyzing how my parallel computations actually speed up on 16-core processor. And the general formula that I concluded - the more threads you have the less speed per core you get - is embarassing me. Here are the diagrams of my cpu load and processing speed: So, you can see that processor load increases, but speed increases much slower. I want to know why such an effect takes place and how to get the reason of unscalable behaviour. I've made sure to use Server GC mode . I've made sure that I'm parallelizing appropriate code as soon as code does nothing more than Loads data

Scaling Docker containers in the real world

女生的网名这么多〃 提交于 2019-12-03 14:41:29
问题 I have a few basic questions on scaling Docker containers: I have 5 different apps. They are not connected to each other. Before having containers I would run 1 app per VM and scale them up and down individually in the cloud. Now with containers I get the isolation on top of a VM, so now I can potentially run one host with 5 docker containers where each app is isolated in its own container. As long as I have enough resources on my host I can scale up and down those containers individually as

using mqtt protocol with kafka as a message broker

﹥>﹥吖頭↗ 提交于 2019-12-03 14:23:38
How can we use mqtt protocol with kafka as a message broker? The clients(android/ios/desktop java apps etc) will be producing and consuming messages using mqtt phao client side libraries which are available in different languages using kafka as a message broker. Any advice? You can use a Kafka source connector which will stream data from an MQTT broker like Mosquitto into a Kafka cluster. See https://github.com/evokly/kafka-connect-mqtt The simplest way to run the connector is in standalone mode, where a single instance will be running on the Kafka cluster on a single node. You can also run it

Monitoring changes in Google Drive files for whole domain using Drive API

半腔热情 提交于 2019-12-03 14:14:49
问题 we are creating Google Drive moderation application to keep list of changes for all files in a Gapps domain. The problem is that we need to impersonificate as every single user - one by one - in order to get all the changes since it seems there is no global API method for this. This is terrible approach for scalability since we have loads of users (10000+) and loads of changes for each of them. Is there any way to get changes of files for whole domain at one shot or at least in some more

DB design and optimization considerations for a social application

好久不见. 提交于 2019-12-03 13:46:35
问题 The usual case. I have a simple app that will allow people to upload photos and follow other people. As a result, every user will have something like a "wall" or an "activity feed" where he or she sees the latest photos uploaded from his/her friends (people he or she follows). Most of the functionalities are easy to implement. However, when it comes to this history activity feed, things can easily turn into a mess because of pure performance reasons. I have come to the following dilemma here: