If you’re in the cloud, avoid the disk

According to Wordnik technical co-founder and vice president of engineering Tony Tam, unless you’re willing to spend beaucoup dollars on buying and operating physical infrastructure, cloud computing is probably necessary to match the scalability of NoSQL databases.

As he explained, Wordnik actually launched on Amazon Web Services and used MySQL, but the database hit a wall at around a billion records, he said. So, Wordnik switched to MongoDB, which solved the scaling problem but caused its own disk I/O problems that resulted in a major performance slowdown. So, Wordnik ported everything back onto some big physical servers, which drastically improved performance.

And then came the scalability problem again, only this time it was in terms of infrastructure. So, it was back to the cloud. But this time, Wordnik got smart and tuned the application to account for the strengths and weaknesses of MongoDB (“Your app should be smarter than your database,” he says), and MongoDB to account for the strengths and weaknesses of the cloud.

Among his observations was that in the cloud, virtual disks have virtual performance, “meaning it’s not really there.” Luckily, he said, you can design to take advantage of virtual RAM. It will fill up fast if you let it, though, and there’s trouble brewing if requests start hitting the disk. “If you hit indexes on disk,” he warned, “mute your pager.”

Foursquare’s Cooper Bethea echoed much of Tam’s sentiment, noting that “for us, paging the disk is really bad.” Because Foursquare works its servers so hard, he said, high latency and error counts start occurring as soon as the disk is invoked. Foursquare does use disk in the form of Amazon Elastic Block Storage, but it’s only for backup.

EBS also brings along issues of its own. At least once a day, Bethea said, queued reads and writes to EBS start backing up excessively, and the only solution is to “kill it with fire.” What that means changes depending on the problem, but it generally means stopping the MongoDB process and rebuilding the affected replica set from scratch.

Monitor everything

Curt Stevens of the Disney Interactive Media Group explained how his team monitors the large MongoDB deployment that underpins Disney’s online games. MongoDB actually has its own tool called the Mongo Monitoring System that Stevens said he swears by, but it isn’t always enough. It shows traffic and performance patterns over time, which is helpful, but only the starting point.

Once a problem is discovered, “it’s like CSI on your data” to figure out what the underlying problem is. Sometimes, an instance just needs to be sharded, he explained. Other times, the code could be buggy. One time, Stevens added, they found out a poor-performing app didn’t have database issues at all, but was actually split across two data centers that were experiencing WAN issues.

Oh, and just monitoring everything isn’t enough when you’re talking about a large-scale system, Stevens said. You have to have alerts in place to tell you when something’s wrong, and you have to monitor the monitors. If MMS or any other monitoring tools go down, you might think everything is just fine while the kids trying to have a magical Disney experience online are paying the price.

By the numbers

If you’re wondering what kind of performance and scalability requirements forced these companies to MongoDB, and then to customize it so heavily, here are some statistics:

• Foursquare: 15 million users; 8 production MongoDB clusters; 8 shards of user data; 12 shards of check-in data; ~250 updates per second on user database, with maximum output of 46 MBps; ~80 check-ins per second on check-in database, with maximum output of 45 MBps; up to 2,500 HTTP queries per second.
• Wordnik: Tens of billions of documents with more always being added; more than 20 million REST API calls per day; mapping layer supports 35,000 records per second.
• Disney: More than 1,400 MongoDB instances (although “your eyes start watering after 30,” Stevens said); adding new instances every day, via a custom-built self-service portal, to test, stage and host new games.

For more-technical details about their trials and tribulations with MongoDB, all three presentations are available online, along with the rest of the conference’s talks.

Feature image courtesy of Tony Tam, Wordnik.

Related research and analysis from GigaOM Pro:
Subscriber content. Sign up for a free trial.

• Putting Big Data to Work: Opportunities for Enterprises
• Migrating media applications to the private cloud: best practices for businesses
• Infrastructure Q3: OpenStack and flash step into the spotlight

alt=''
border='0'
/>

GigaOM

The Pulitzer board, which administers the journalism awards named after newspaper publisher Joseph Pulitzer, has changed the terms of submission to require digital entries only, and has also changed the description of the “breaking news” category to stress that real-time reporting will be the main criteria for that award. That has led some — including the Nieman Journalism Lab at Harvard — to speculate that we could see a Pulitzer Prize for live-tweeting of the news. Whether that ever comes to pass or not, there is a case to be made that Twitter is the best tool for breaking news that the world of journalism has seen in a long time.

Although the Pulitzer board didn’t say why it made the changes to the criteria for the breaking-news award, it may have done so in part because the award went without a winner in 2011 — although there were three finalists nominated by the judges, including the Chicago Tribune and the Miami Herald, none were chosen.

Reporting that captures news “as quickly as possible”

The old version of the criteria said that the award would be given “with special emphasis on the speed and accuracy of the initial coverage, using any available journalistic tool, including text reporting, videos, databases, multimedia or interactive presentations or any combination of those formats, in print or online or both.” The new version of the criteria is substantially shorter, and doesn’t mention anything about the format that it is supposed to appear in or what kinds of tools the reporting should use. It simply refers to:

[R]eporting of breaking news that, as quickly as possible, captures events accurately as they occur, and, as times passes, illuminates, provides context and expands upon the initial coverage.

In a news release about the changes, the Pulitzer board also said that it was moving away from looking at print submissions for the category because “it would be disappointing if an event occurred at 8 a.m. and the first item in an entry was drawn from the next day’s newspaper.” Although recent winners have included online elements, most have focused on news packages that appeared in print.

If reporting that occurs “as quickly as possible” is the main criteria, then I think Twitter definitely fits the bill — or is at least a leading contender. Videos uploaded to YouTube or streamed from a news event like the “Occupy Wall Street” protests (as my colleague Janko described in his recent post on videographers becoming citizen journalists) are also clearly real-time, but nothing matches the speed that is possible with 140 character text messages and links on Twitter, and videos and photos often spread this way as well.

An obvious candidate: NPR’s Andy Carvin

As for who has demonstrated the kind of reporting prowess on Twitter that might justify a Pulitzer, many of those who have followed the events of the “Arab Spring” through his Twitter stream would probably nominate National Public Radio editor Andy Carvin, who has turned the network into a kind of real-time newswire. Although many criticize Twitter for broadcasting un-verified information, Carvin has shown that a rigorous approach to fact-checking and a knowledge of the players involved can make it a reporting tool as good as — if not better than — any other we have known.

There are other good examples as well, including New York Times reporter Brian Stelter’s use of Twitter (and his Tumblr blog) to cover the tornado in Missouri earlier this year, which also gave readers a look behind the scenes at his reaction to the events he was witnessing — another thing Twitter excels at. And other reporters have also made use of the network while on the ground in Tahrir Square in Egypt and elsewhere in the Arab World, as well as during the earthquake and subsequent tsunami in Japan earlier this year.

One of the things that might make Carvin and some of these other examples ineligible for a breaking-news Pulitzer is that the criteria specifically mentions “local reporting,” which means posting to Twitter about events in Egypt might not fit the bill — although some of the reporting that news organizations have done using Storify and other tools during the Occupy protests in Los Angeles and New York might qualify.

If nothing else, the Pulitzer board seems to have upped the ante for newspapers and other traditional media outlets who want to compete for the breaking-news award: if you are planning to just publish something the next day — or even post traditional stories to your website — and you’re not thinking about video or Twitter or Storify or some combination of those tools to cover the event, you can kiss your Pulitzer goodbye.

Post and thumbnail photos courtesy of Flickr users Rosaura Ochoa and

Related research and analysis from GigaOM Pro:
Subscriber content. Sign up for a free trial.

• Content Farms: The Players, The Benefits, The Risks
• Facebook and the future of our online lives
• NewNet Q1: Content Farms and Niche Networks on the Rise

alt=''
border='0'
/>

GigaOM

Herrod didn’t have any products to launch but he said the company is working on ways to run a Hadoop cluster on a virtualized machines, even machines that might be running other workloads. The idea of an elastic Hadoop cluster that can be used on-demand or perhaps in the evening for big analytics jobs, is compelling, and Herrod expects to share more information on this next year, maybe even at our Structure Data conference in March 2011. Check out the video below and see for yourself.

Related research and analysis from GigaOM Pro:
Subscriber content. Sign up for a free trial.

• Infrastructure Q1: IaaS Comes Down to Earth; Big Data Takes Flight
• Infrastructure Overview, Q2 2010
• Big Data Marketplaces Put a Price on Finding Patterns

alt=''
border='0'
/>

GigaOM

IO Turbine’s software helps virtualized servers manage their access to Flash memory, and enabled companies to put workloads such as databases that require fast access to memory in the cloud. FlashSoft and others also are hoping to compete in this space as solid state drives and Flash memory become more common inside corporate data centers.

It made sense that Fusion-io, which is providing the hardware to build out distributed Flash memory would be interested in picking up a software layer that could make its hardware more functional. Companies such as Facebook are deploying servers with Fusion-io cards inside them, creating a network of distributed storage that has to be managed. IO Turbine’s software can do that. IO Turbine’s software works with any solid state drives that use Flash (or even hard drives) and Fusion-io will offer it bundled with its components or on a standalone basis.

David Flynn, CEO of Fusion-io, said the two companies had been working together for the last year or so, and once Fusion-io went public it had the resources to buy IO Turbine,” We didn’t try to go public to get bought, but to do the buying,” he said referring to a story I had written in March when Fusion-io filed to go public and I suggested the move was a feint to drive up interest so someone would acquire the company.

Instead it was part of a strategy to get people interested in Fusion-io as more than just a provider for webscale companies trying to improve performance on a small subset of Internet apps that have to access a lot of data really quickly. Flynn wants to convince enterprise buyers that performance Flash belongs in their servers. With IO Turbine’s software running on the Fusion hardware, enterprises can continue consolidating their IT resources by putting more virtual machines on a server without slowing down the VMs’ ability to access stored data.

Once companies realize that the transition to Flash Memory (while more expensive on a per gigabyte basis than hard drives) can save them in terms of server costs because they can run more applications on a server, or even host more applications in the cloud, Flynn believes that Fusion-io can break into the enterprise market. This new product is the first big step.

Related research and analysis from GigaOM Pro:
Subscriber content. Sign up for a free trial.

• Infrastructure Q2: Big data and PaaS gain more momentum
• The Structure 50: The Top 50 Cloud Innovators
• Infrastructure Q1: IaaS Comes Down to Earth; Big Data Takes Flight

alt=''
border='0'
/>

GigaOM — Tech News, Analysis and Trends

convert VOB to AVI

One thing that you will want to examine when looking at hotel administration software is the scalability of the system. The explanation for that is that most people will want to expand their resort enterprise and not have to purchase a brand new system every time. Having a software program system that may expand and adapt to your wants is very important as it is going to prevent cash and time.

Increasing and enhancing your hotel PMS

Having a hotel PMS that is very restricted could be disastrous if you’re desirous about expanding your business. This growth can be anything from including on more rooms to buying another resort to form a chain. If your system has a limit on the number of rooms it can deal with then you will see a huge downside when making an attempt to expanding. For this reason it’s best that you just look for property administration software program that’s modular and expandable. Modular programs will let you later add on extra features so to increase your business. You must also test that the system can deal with multiple property. There are some software program packages that are created solely for people who are going to have only one lodge and this can be dangerous for you if you discover that you could develop to have more than one hotel.

The database your lodge administration software program makes use of

The kind of database that your lodge management software is utilizing could be very important. Some of these programs will use older databases resembling Entry however these are the ones that you need to avoid. The rationale for that is that you probably have an older database you won’t be able to improve and develop it as easily as a more recent one. One type of newer database that you should have a look at having is SQL based mostly databases. One of these database is also a lot easier to make use of than older database types. This is as a result of SQL language that makes up the database which has been created to help folks manage their databases more effectively. One of many SQL databases that you could be use is Microsoft SQL server.

Resort management system that may assist a number of databases

Being able to assist multiple databases is another thing that your resort administration system ought to have the ability to do. If in case you have a large lodge business that has over a thousand rooms then it is suggested that you just use Oracle databases. This in fact doesn’t imply that you just can’t use a Microsoft database you probably have a big chain or hotel. Your hotel management system should be able to deal with a variety of various databases as everybody will need to use what they’re snug with. Moreover in case your hotel business grows you then might want to change databases from Microsoft to Oracle with out having to get new software. This is why it is best to at all times verify to see what the software program you want to purchase will support.

Scalability of resort management software program is very important for you if you assume that you may want to expand your enterprise within the future. Having software that may change with you’ll save you time and cash as you do not need to purchase new software program and have it installed.

About The Creator

Jacob has been writing articles online for nearly 9 years now. Not only does this writer focus on Computers and Technology, you can even try his newest website on how you can convert VOB to AVI with VOB to AVI converter which also helps people find the best VOB to AVI converter on the market.

The question is — does the world need another real-time data processing tool? After all there are many tools like HStreaming (using Hadoop), the open source S4 and StreamBase, but the overall analytics market (if you can call it a market) is already fragmented. The Storm code comes from Twitter’s acquisition of BackType last month and seems to be an effort to get folks comfortable parsing data on Twitter.

The post does an excellent job laying out use cases for Storm and hints at more to come. While the code can deal with distributed nodes and huge amounts of data a la Hadoop or Map Reduce, Storm handles jobs that are “infinite.” It’s not for a data processing job with an end point, it’s good for streams of data and continual processing. From the post by Nathan Marz:

Here’s a recap of the three broad use cases for Storm:

• Stream processing: Storm can be used to process a stream of new data and update databases in realtime. Unlike the standard approach of doing stream processing with a network of queues and workers, Storm is fault-tolerant and scalable.
• Continuous computation: Storm can do a continuous query and stream the results to clients in realtime. An example is streaming trending topics on Twitter into browsers. The browsers will have a realtime view on what the trending topics are as they happen.
• Distributed RPC: Storm can be used to parallelize an intense query on the fly. The idea is that your Storm topology is a distributed function that waits for invocation messages. When it receives an invocation, it computes the query and sends back the results. Examples of Distributed RPC are parallelizing search queries or doing set operations on large numbers of large sets.

But wait! There’s more! At the end of the post we are assured that there’s more to Storm than the blog post has even defined, which we can learn more about next month at the Strange Loop event. From the post:

I’ve only scratched the surface on Storm. The “stream” concept at the core of Storm can be taken so much further than what I’ve shown here — I didn’t talk about things like multi-streams, implicit streams, or direct groupings. I showed two of Storm’s main abstractions, spouts and bolts, but I didn’t talk about Storm’s third, and possibly most powerful abstraction, the “state spout”. I didn’t show how you do distributed RPC over Storm, and I didn’t discuss Storm’s awesome automated deploy that lets you create a Storm cluster on EC2 with just the click of a button.

So for those anxious to test out a new method of crunching terabytes of real-time data on the fly, get thee to GitHub! And wait.

Related research and analysis from GigaOM Pro:
Subscriber content. Sign up for a free trial.

• Defining Hadoop: the Players, Technologies and Challenges of 2011
• Infrastructure Overview, Q2 2010
• Big Data Marketplaces Put a Price on Finding Patterns

alt=''
border='0'
/>

GigaOM — Tech News, Analysis and Trends

One of the leading methods of identity theft protection reviews is data breaching and it occurs thousands of times each and every day. These breaches are like an open door and a thief can just walk right in and take any information that they want. There is a feature included in all packages that monitors databases and tells customers who are in danger of breaches.

When you sign up for this program, you will be asked to fill out a questionnaire about your daily activities. This will allow the program to determine how at risk you are for identity theft. They will probably be able to point out some things that should be changed to ensure your safety.

Spyware programs are specifically designed to spy on people when they are inputting sensitive information into their computers. These programs can be picked up all over the web and they will report back to whoever is operating them on whatever they find. There is a program that will be installed to your computer that will detect and prevent spyware from attacking your computer.

Viruses can be annoying and can cause a lot of damage to your computer. They can also cause you to lose important information. It is possible to contract a virus that not only destroys the files on your computer but that copies the information and transfers it to another computer. This program will alert you and any other member whenever a new virus is detected. This will enable you to make sure that your computer is protected.

Our identities aren’t the only things that we worry about losing. It can be a horrifying experience to have your child go missing and it is important to find the child as quickly as possible. This program will send out alerts to any member in your area that will describe the missing child and anyone who might be with them. This will make it easier to find them and get them home.

Sex offenders are required to register their home addresses with the local authorities. This program will ensure that you know where all the sex offenders in your area are and it will alert you if a new one moves into your area. This will make it easier to keep your family safe.

All this means is that this is a viable option to anyone who is looking for a way to protect themselves with Guard Dog ID. There are many other programs out there that you can check out before you make a decision to prevent identity theft protection reviews. You will want to learn all that you can about all the options available to you so that you get the one that best fits your needs and the needs of your family.

Many people make their biggest mistake by tossing out old papers that have personal information or even by just throwing away the wrong junk mail that makes them an instant target. Sometimes people are unlucky enough to misplace or have their wallets stolen. If these people had identity theft protection reviews, there would be no problems keeping their life on track.

The best part is that with the right company, these services are not even expensive but rather something that everyone should be able to afford. Now finding the right place to secure identity theft protection with might be tricky at first since so many choices are available. However one great way to decide is by looking at all of the services that are available from different companies and organizations.

Making sure that one that is chosen offers all of the requirements that are needed is easy. This is because there is a ton of information available on the services online. Just going to the website and reading about them can really save time and energy.

So for one to really protect themselves, all they would need to do is buy the best identify theft protection. These special services are a great way to keep updated on the activities of different databases. Plus most of the companies watch the person’s credit cards as well with those additional databases.

What this essentially means is that the protection actually helps against credit card theft too and allows the person to be notified of suspicious activity. The owner of the credit cards would find that they are immediately contacted and protected if such an event were to happen. So their credit can be clear much quicker then if they were not to have the service.

Having problems with credit is a nightmare that no one really wants to have to face. So with being able to have that protection from an identity theft protection service it is something that can be done easily. Since the invention of the internet, there have been more problems with identity and credit theft as those who steal can work quicker.

This means that everyone should check out the available identity theft protection from Lifelock through LifeLock Command Center Coupon. The company offers some of the best choices in identity theft insurance today. So clients can rest assured that their identity and their life is safe from predators who are out there waiting to steal someone else’s life.

Fourth, hosting providers have become much more demanding with regard to the protection of customer data. Previously, the safety of your page on the server completely depended only on your foresight. You simply had to store a date copy of your site on your home computer. Now you can’t face such problems in most cases. Fifth, the contemporary conception of web hosting has to include a wide range of various types of additional services such as mailboxes, databases, scripts, statistics, protection from spam and viruses, mailing lists and so on.

And with all this wealth of services this can be yours for a very small cost such as 5 – 20$ depending on the disk space and certainly a set of provided services. I should emphasize that at this level the cost of similar packages of services with different hosting providers differs only slightly. I can’t say that the best web hosting packages cost 10$ while another one 30$. The difference is usually just two or three dollars and no more in most cases. But don’t forget that just a couple of dollars per month can mean a very substantial difference in the level and types of services provided.

When a particular user being tempted by a prospect to save two dollars a month switches to a new hosting provider, suddenly it turns out that there is a bad tech support there accepting requests only from 11 to 17, except weekends. Certainly they keep silence now. They don’t respond at all. May be the electricity is cut down or something else. But it’s evident in this situation that there is no protection for the provider and all services are dead. Is it because of extra two dollars a month? I think that you shouldn’t sacrifice your nerves in this case. You’d better stick to more expensive but more reliable service. These two bucks aren’t so worthy to worry about. Got it? So get started with this knowledge.

Today many brands hide behind a lovely notion as best web hosting. Though this positive notion helps to make more sales, the term of best web hosting is very vague.

What is in the nutshell?

Surely one can talk about uptime, reliability, support, peculiar tech features – and all this will be up to the point. But best web hosting is far beyond, and in simple terms this is about the place where you have no problems when hosting your web site or blog.

Today we live in the world where knowledge quickly enhances the quality of our life.

Due to this if you are properly armed with the knowledge in your topic you can rest assured that you will in any case find the solution to any bad situation. So, please make sure to get back to this site on a regular basis or – the easiest way to take care of it – sign up to its RSS feed. In such an easy way you will have a direct shortcut to the latest informational updates here. Blogs can be helpful, you just need to understand how to use them.

AppleWorks features six applications for your core tasks: word processing, page layout, image editing, spreadsheets, databases, and presentations. This version of AppleWorks opens and saves Microsoft Word and Excel files using DataViz translators, and converts your documents to PDF using Print Preview in Mac OS X. You can add text, images, sounds, movies, spreadsheets, charts, and tables to any document by dragging and dropping. For presentations, you can include titles, captions, pictures, music, and video, sort your slides using drag and drop, and prepare speaker’s notes for each slide. You can also use an assistant or template to get a head start on your document, and tap an expanding library of Internet-based templates. There are also over 50 fonts in a variety of styles.

Rating: (out of 10 reviews)

List Price: $ 80.99

Price: $ 201.90

More IPad Products