понедельник, 10 октября 2011 г.

Datafiniti builds a webscale search engine for data


There’s a lot of talk about the democratization of data, but simply making data sets publicly available leaves unresloved a couple of key problems. One is that users have to know the data is available, and the other is they have to know how to work with it to get the information they want. Austin, Texas-based startup Datafiniti is looking to change that with a search engine that it hopes will make finding relevant data as easy as finding relevant web sites using Google.


Datafiniti’s web-based service is as simple as entering SQL parameters into a search box, clicking “search” and watching the results display. The interface even suggests relevant search terms as users type, based on the categories of data available in the Datafiniti platform and the different fields by which it’s sorted. Once users have the information, they can use the supplied API to feed their application with the information, or they can export it as CSV files or JSON objects.



The service is pretty clearly targeted at developers wanting to build data-centric web applications and, as founder and CEO Shion Deysarkar explained to me, Datafiniti tries to differentiate itself with the aforementioned API. Users get just one API that offers up access to multiple data types, which contrasts with the traditional mashup experience of using a different API for each data source.


As of a couple weeks ago, Deysarkar told me Datafiniti consisted of about 15 million records, but it’s constantly growing and his goal is to index “any and all structured data on the web.” Datafiniti launched today with five available data types — Location, Social or Identity, Product, News and Real Estate — but Deysarkar said there will be many more to come.


Jeff Ferries, Datafiniti’s VP of sales, told me that Datafiniti also targets business users. Firms such as Dun & Bradstreet, Axciom and Experian, he explained, are limited in the types of data they can compile, and they usually can only add data monthly as their source material is updated. Deysarkar said that process, which involves opening a physical catalog, flipping through listings and calling a broker, is “pretty ridiculous,” especially considering that data might be out of date by the time it’s complete.


If Deyasarkar’s name sounds familiar, that’s because he’s the founder of 80legs, a high-powered web-crawling service whose launch my colleague Stacey Higginbotham covered in 2009. 80legs as a company no longer exists, but the service powers Datafiniti by constantly crawling the web and adding new data, and it’s still available as a product from new parent company Datafiniti.


The image above shows a search string for restaurants located in Austin and its results, but this video offers a more-thorough walkthrough of the Datafiniti experience.



Good Technology gives enterprise apps a secure launchpad


Good Technology has already enabled companies to extend security and management to a fleet of mobile devices that consumers are bringing to their IT managers. However, the underlying structure has worked primarily with some basic applications such as email, contacts and calendar.


Now, the company is looking to extend its technology to independent software developers, corporate customers and systems integrators, allowing them to build apps that can ride on Good Technology’s secure platform. The new product, called Good Dynamics, will allow developers to create and manage secure mobile apps using Good’s infrastructure, which acts as a container around the application and all of its data. That should enable companies that have been itching to create their own in-house apps or software developers looking to sell apps to corporations to move ahead with apps that will meet tough security standards, which is important for many business customers.


Nicko van Someren, CTO of Good Technology, told me in an interview that many enterprise customers have worked up apps in-house but they can’t deploy them because they haven’t passed the necessary security requirements. He said with Good Dynamics, enterprise customers can move ahead with those apps while leaving the task of encryption, authentication and connectivity to Good.


“It’s not just about encryption, transport and security, it’s a holistic solution to manage these apps,” van Someren said. “In regulated industries, you need to be seen as keeping data secure.”


Developers can plug Good Dynamics’ code libraries into their apps to secure their data and get access to it. Good Technology maintains the Network Operating Center infrastructure and, in the event of a security breach, customers can kill the Good Dynamics-enabled app without affecting any personal data on the device. Good has already been testing Good Dynamics with a number of software makers and clients, including Aji, Accellion, Box, GroupLogic, MeLLmo, Pyxis Mobile, Quickoffice and Unisys.


Good Technology will offer Good Dynamics alongside its Good for Enterprise, Good forGovernment, and Good for OEM/Carriers products. It should be available for customers next month.


Good Dynamics is a logical next step for Good Technology. The company can try to create apps itself for enterprise customers but it makes more sense to extend its platform to a host of apps already waiting for more security. In this app-addicted world, Good’s in a strong place to capitalize off the habits of companies and end-users.


Warner Bros. closes HBO window ahead of UltraViolet launch


Warner Bros. has confirmed it will no longer be beholden to rights that would see its movies disappear from streaming sites while those titles are available on HBO and its HBO Go web and mobile applications. The closing of this so-called “HBO window” could go a long way toward making digital ownership of UltraViolet titles more appealing to consumers.


UltraViolet hopes to make digital ownership of movies more attractive, by allowing consumers to buy a title once and access it anywhere or on any device. One of the big questions revolving around the impending launch of UltraViolet streaming video services was whether or not studios would have to deal with the rights window, during which HBO has exclusive access to those titles online. Until recently, that meant movies purchased online couldn’t be accessed while HBO had pay TV rights to that content.


On a press briefing Monday afternoon ahead of the launch of the first UltraViolet-enabled title, Horrible Bosses, Warner Home Entertainment execs said that its movies won’t be subject to the HBO window. As a result, anyone who purchases a Warner Bros. DVD or Blu-ray disc won’t have to worry about losing access to the movie online or being blacked out once HBO gets ahold of it.


That doesn’t mean that HBO’s other studio partners — 20th Century Fox and Universal Pictures — aren’t still subject to the same restrictions. Warner Bros. execs wouldn’t comment on where its competitors stood with regards to whether or not HBO had streaming exclusive rights to their movies when they enter the pay TV window. Of course, Warner Bros. and HBO are both part of media conglomerate Time Warner, so their interests are more likely aligned than HBO would be with other studios.


The news that HBO has restructured its deal to allow Warner customers to stream its movies whenever comes at the same time that it is making a big digital push of its own. The premium cable network is making all its movies and original TV series available online, on mobile devices and on connected TV platforms through its HBO Go initiative. Part of Time Warner’s broader TV Everywhere push, HBO Go gives users the ability to access on-demand content as long as they prove that they’re cable subscribers.


Why Silk won’t be silky smooth for Amazon





Amazon in late September launched new Kindle devices including Kindle Fire, a tablet that makes content a centerpiece of its tablet strategy. It also announced a new browser, Amazon Silk, that proposed to use cloud to offer a blazing fast experience. Silk’s hybrid browser architecture quickly triggered some privacy concerns. Amazon weighed in on my queries and clarified their position.


Nevertheless, I have continued to receive feedback, some private and some over various social networks. One that stands out is from Mathew Prince, co-founder and CEO of Cloudflare, a hosted proxy service provider based in San Diego who shared his thoughts. Prince, (you can follow him on Twitter @eastdakota) who teaches cyber law at John Marshall where he serves on the Board of the Center for Information Technology & Privacy Law, believes Amazon will continue to face “technical, legal, and privacy concerns with Silk.” He points out that similar attempts in the past have not been very successful, even for Google.


Amazon’s Silk Browser may be a game changer, but the history of similar efforts shows the company may face significant headaches in getting it to work. The Silk Browser loads pages through a proxy which can have a number of benefits to end users. Depending on how aggressive the Silk proxy is, it could speed up browser performance, allow Kindle devices to get away with slower, less expensive processors, and potentially even increase the battery life by offloading web rendering.


The Silk Browser it isn’t really new technology and it’s not a slam dunk that it will work. The Opera Mini browser uses a proxy which has several of the same features as Amazon’s Silk. Google tried something similar back in 2005 with their Web Accelerator Plugin. While the plugin is no longer available, the support documents still are. Google discontinued support in early 2008 after a number of issues arose — similar issues that are likely to be faced by Amazon with Silk.


I predict that Amazon is likely to face technical, legal, and privacy concerns with Silk. Technically, the biggest challenge will likely be cache invalidation. If I visit my bank website and my account page is cached, Amazon needs to be 100 percent certain that when someone else visits the same bank they never see my account information. From the technical specifications, it appears that Amazon is only caching static resources such as images. While that will solve many of the cases, there will still be places that Silk could end up leaking private data (e.g., a stock photo or porn site that charges for access to its photos).


Unlike existing proxies (like CloudFlare) or traditional CDNs whose clients are the website owners, Amazon’s clients are the web browsers, so they are copying content without the content owners’ explicit permission. This could lead to copyright headaches. While there are safe harbors for service providers caching content, Amazon’s nebulous status between network provider, retailer, and even publisher could muddle their case in court and make them a tempting target. The more Amazon alters the content in order to increase performance, the more jeopardy they will put themselves in.


Finally, Silk potentially puts Amazon in the privacy crosshairs. It appears they are planning to subsidize some of the Kindle’s pricing with advertising, and that advertising will likely be most effective if it is targeted using browsing data gleaned from Silk. Users and regulators can react very strongly if they feel their information is being sold without their permission, and Silk has the potential to score high on the creepiness factor. These privacy concerns have a way of blowing up unexpectedly with regulators resulting in substantially burdensome regulation. In this case, Amazon has already made many government enemies as they’ve fought Internet sales tax initiatives. Going after them for privacy violations may prove a tempting target for lobbyists that already trying to demonize them.


My hunch is that Amazon will find a way to pull it off, but it won’t entirely be smooth for Silk.


What do you think about Prince’s take?


For mobile in-app sharing, Twitter tops Facebook 3-1


Mobile developers are increasingly finding the power of social integration in their apps, which is one way to make them engaging and sticky and to help get the word out about their apps. But all social integrations are not equal.


User by user, Twitter integrations on mobile apps drive three times as much sharing as Facebook integrations, according to new data from app analytics firm Localytics. And the advantage is even more pronounced when you look at active users.


Localytics examined all mobile apps with more than 500 monthly active users connecting to Facebook and Twitter from January through July 2011. It found that 20 percent of all mobile apps on Android, iPhone, iPad, BlackBerry and Windows Phone 7 apps have social integration through Facebook or Twitter. Facebook is the most popular social network by far: 10 percent of all apps connected to Facebook only, compared to just one percent of apps that connect to Twitter only. Nine percent of apps connect to both Twitter and Facebook.


Compared to Twitter, Facebook overall generated twice as many events, which Localytics counts as sharing, liking or following by a person from an app. But on a pound for pound basis, Twitter won out handily when it came to driving user engagement. The average Twitter user shared three times as many events than the average Facebook user, Localytics found. When you examine the active user base of each network, Twitter generated 50 events per 1,000 users compared to 11 events per 1,000 Facebook users, said Localytics.


Now, Facebook has a far bigger community with 800 million users, including 350 million who access the service through a mobile device. Twitter has more than 200 million accounts registered with 100 million monthly active users. So with that size advantage, it’s not surprising that Facebook produces more user events overall.


Daniel Ruby, director of online marketing for Localytics, said it might be that Twitter’s more flexible approach to identity, which allows people to be more anonymous, can prompt more sharing. It’s also probably due to the inherent differences in the two services. Facebook is more of a personal network of friends, while Twitter is often used as a broadcast communications platform for sharing information. I know I find it easier to Tweet something than sharing it on Facebook, where I might be sensitive to overwhelming my friends. But having two options can be helpful for people who might share differently according to each situation.


For developers, it’s important to know what tools are available and how they might differ. Twitter has smaller reach, but it has a very active user base. And with its iOS 5 integration, it might be in a position to grow rapidly. For the four of every five apps that don’t have social integration, their developers might want to think about adding it. As I wrote about earlier, there are a lot of apps that don’t connect to backend services of any kind. But the payoff for those that do are more engaging and dynamic apps, especially ones that have social integration. Those apps can not only keep people involved, but they can draw in new users who can be attracted through sharing on social networks.


And as Localytics points out, developers can also get interesting insight into what features or content are popular on an app based on what people are sharing. That can help them tweak or tune the app accordingly.


Memo to newspapers: Let your readers inside the wall



The Guardian, the U.K. newspaper that has been one of the biggest mainstream-media champions of a “digital first” approach and a proponent of “crowdsourcing” the news, says it’s now going to experiment with allowing readers to help decide what news to cover. The paper announced Monday that it’s going to make its “newslist” — the daily schedule of stories the media outlet thinks are worth covering — public, something which the paper has previously kept carefully guarded. But the Guardian seems to have realized what many newspapers have not: If you allow your readers to be part of the news-creation process, they will be more engaged.


In a column announcing the experiment, Guardian National News Editor Dan Roberts says the idea of showing readers — and everyone else — what stories the paper is working on might seem a little strange, since many publishers try as hard as they can to keep this kind of information secret (in some cases, rival newspapers in Britain have paid leakers for access to a competitor’s newslist). But the Guardian editor says that the paper believes opening up to its readers will improve the quality of its reporting, and help it concentrate on the stories that will be of the most interest and/or value. Said Roberts:


What if readers were able to help newsdesks work out which stories were worth investing precious reporting resources in? What if all those experts who delight in telling us what’s wrong with our stories after they’ve been published could be enlisted into giving us more clues beforehand? What if the process of working out what to investigate actually becomes part of the news itself?


Let readers in and they will help make your work better


Roberts notes that The Guardian isn’t opening up its entire newslist, and will be excluding any exclusives the paper might have, as well as embargoed stories that have been planned in advance. And the editor also says the newspaper is looking at this as an experiment, and is prepared to “pull the plug” on the trial period if competitors are benefiting too much — or if readers simply aren’t interested. That said, however, Roberts says the paper is convinced that offering this information to readers will help focus its news-gathering better and provide tips that can improve stories.


[W]e think there are lots of routine things that we list every day which might provoke interesting responses from readers: everything from upcoming press conferences, to stories we need help uncovering. If readers can see that we’ve got a reporter looking into the police killing of someone with a Taser – to use a recent example – they might be able to direct us to other recent deaths or the definitive report on their safety risks.


What the Guardian is doing is quite simple: it is letting its readers behind the wall, pulling back the curtain to show them some of the machinery involved in producing the news, and offering them the chance to help — a smart approach that other media outlets could and should emulate. It’s an extension of what the British paper did with its groundbreaking “MP Expenses” project in 2009, which involved uploading more than 200,000 official expense reports for British politicians and then asking readers to comb through them looking for errors or fraud. In the end, more than 20,000 people did just that, in one of the most successful crowdsourcing projects ever undertaken by a newspaper.


Using readers as a resource is one thing, but revealing what stories are planned and offering to let readers affect that process is another. In the not-too-distant past, most newspapers were almost as secretive as government agencies; the processes involved in producing journalism day-to-day were only revealed to members of the priesthood, and things like story lists were kept under virtual lock and key. Needless to say, this kind of culture isn’t conducive to things like blogs or story comments or Twitter, as is obvious from many mainstream media companies’ restrictive social-media policies.


They are the “people formerly known as the audience”



But opening up to readers — or what journalism professor Jay Rosen has called “the people formerly known as the audience” — has obvious benefits, as Roberts notes. For one thing, if they’re involved in a particular story, they can provide details and perspectives that might never have come to light during the traditional reporting of a news event. No matter how expert a journalist might be at covering his or her beat, there’s always going to be someone who knows more about that topic, and giving them the chance to contribute to a story makes the end product better, whether reporters want to admit it or not.


As Roberts notes, this approach has paid dividends for other newspapers that have tried it, including a Swedish regional newspaper that has been experimenting with an “open newsroom.” The large daily uses a live-blog powered by CoverItLive (owned by Demand Media) that’s run by a senior editor, which provides a place for the paper’s staff to talk about the stories they are working on, and allows readers to post their comments and questions. The paper’s editor-in-chief says that doing this has not only driven traffic to the site, but created a more engaged readership.


Other newspapers experimenting with open newsrooms include the Register-Citizen in Connecticut, part of the Journal-Register Co. group — which, like The Guardian, has taken a “digital first” approach under CEO John Paton, now the CEO of the Media News Group — and the Winnipeg Free Press in Canada. The Register-Citizen allows readers to come and go as they please in the paper’s newsroom, and provides coffee and Internet access, as well as inviting readers to be involved in story meetings. The Free Press, a large daily, has stationed several reporters in a coffee shop/restaurant in the city’s downtown core, so that readers can interact with the paper’s staff more easily.


The bottom line is that the secrecy that newspapers used to operate under no longer works. Not only is there more competition for stories, but mainstream media outlets no longer have a monopoly relationship with their readers, who can find the same information from dozens of alternative sources. Either newspapers develop a more balanced relationship with the people formerly known as the audience, by allowing them to contribute to the process, or they will find their audience has gone elsewhere.


Post and thumbnail photos courtesy of Flickr users Jeremy Mates and Yan Arief Purwanto


5 trends that will shape the future of mobile advertising


Spending in the mobile advertising space will be approximately $4 billion worldwide this year, so despite some perceptions to the contrary, we can safely assume it’s an area to watch in the coming years.


To get a clearer picture of mobile advertising’s future, it helps to first explore the current landscape. Five trends in particular stand out:


More-relevant behavioral targeting. Currently, mobile advertisers use traditional methods of ad targeting: device, demographic group or context. But in five years, mobile ad targeting will become more relevant to a person’s behavior and current location. For instance, online advertising network Adverline has an AdNext server that builds a prediction model of spatial and temporal relevance for delivering ads to mobile users. The company has tested this with the COEX Mall in South Korea, and it found a 70 percent confidence level that ads displayed are spatially and temporally relevant.


Growing mobile search. Mobile search advertising is already a big driver of ad spending; this is where Google currently makes much of its money in mobile. In five years, this will still be the case, as people continue to use mobile devices to search for products and services. What will change is that, coupled with better targeting, search advertisers will deliver more relevant ads based not only on location and relevant keywords but also on more accurate predictability engines.


Better analytics. Right now, the tools for measuring mobile ad campaigns lack the sophistication that advertisers expect. The Mobile Marketing Association and other groups, such as the Interactive Advertising Bureau, have set up good guidelines. But these are still evolving, and not everyone plays by the same rules. In five years, the standards will have matured. Companies will agree more about what gets measured, and analyzing mobile campaign effectiveness will not be as big of a hurdle.


Greater interactivity. Most mobile ads today are delivered as relatively simple text or banner formats. They are clickable but not very interactive. Rich-media ads are available, too, but they are not as widely deployed for a variety of reasons: more cost, and not all devices render them well. In five years, interactive ads will be common, and users will be expanding, collapsing and manipulating them in ways that are still unfolding. This will unleash creative minds to show off their capabilities. Also, technology like augmented reality will make the interaction with brands and the world around consumers more interactive: Imagine looking at your mobile screen and playing a Zynga game sponsored by Coca-Cola, based on your physical surroundings.


Mobile-social as the “personal cloud.” Today the mobile and social worlds already collide with services like Foursquare and Gowalla. In five years, though, this functionality will likely evolve into what some Stanford researchers suggest is the personal cloud, which will be personal data that surrounds us wherever we go. It will also be shareable with whomever we choose and will be used to make purchases, among other things. Savvy advertisers will leverage this trend with relevant offers that provide value but still respect user privacy.


Meanwhile, companies like Google, Apple and Millennial Media currently rule the mobile advertising space, and while some of those will continue to have an impact over the next five years, others leading the way today will fade away or be acquired. To read about these, as well as more trends to watch, please see “The future of mobile advertising, 2011-2016” at GigaOM Pro (subscription required).


Image courtesy of Foursquare.


HTML5 key to Facebook’s mobile app discovery, engagement


Facebook finally launched its native app for Apple’s iPad on Monday, but the ironic, bigger story is wider support for web technologies as Facebook tries to be everywhere on every device. The company shared news with developers on its blog explaining how social app discovery using HTML5 can reap greater engagement as Facebook users can find and run mobile apps in a modern mobile browser.


Focusing on three updated and new functions — bookmarks, requests and news feed — Facebook says of its mobile platform:


[We are] extending Facebook Platform on mobile, bringing all the social channels that have helped apps and games reach hundreds of millions of users on the Web to mobile apps and websites. You can now easily reach the 350 million people who use Facebook every month on a mobile device, including iPad, iPhone, iPod touch, and our mobile web site.


We are at the beginning of bringing Facebook Platform apps to mobile. The features we are launching today are still under development. They will evolve as we learn more about building richer social experiences on mobile devices. In addition, we will extend our native support for more mobile platforms such as Android in the near future.


With the changes, an app bookmark is automatically added to the web-based Facebook app when a user interacts with a mobile app; increasing the odds of re-engagement in the future. The updated requests feature now includes invites to mobile apps and games from friends. And the news feed now includes the use of mobile apps, complete with a link so that friends can tap and see the app for themselves. A new store of about a dozen web apps is also available today and corresponds to the news not just on support for mobile apps, but ways to promote them.


In the browser on my Android device, I hit the app directory at http://fb.me/mobileappshowcase where I played a hand of poker with others on Facebook. The app appeared like a native version; if someone showed it to me, I never would have guessed I was in a browser. And later, I checked the web version of Facebook and found a bookmark to the poker app. I’m likely to play more as a result.



So while a long-awaited iOS version of Facebook debuts today, in my opinion, the long-term growth of Facebook is more likely to come from the continued use of web technologies which provide a relatively common code base across platforms and similar user experience across devices.


While Apple and Google focus more on native apps and app stores, Facebook is pushing forward to legitimize web-apps as a future mobile strategy. And I’m not saying that just because I won $38,900 on that poker hand by drawing a straight to the eight. (True story!)


Finally: Facebook debuts native iPad app


Facebook for iPad (click to enlarge)


Facebook for iPad is finally here. On Monday the social networking company debuted its long-awaited native application for the iPad, capping off months of speculation of the whens and hows of the potential launch.


The app’s interface is made to be especially fitting with the iPad experience, particularly when browsing photos. “Give the screen a swipe to page through albums. Pinch a picture to zoom in,” Facebook mobile engineer Leon Dubinsky wrote in a blog post announcing the launch. “Photos really shine on the iPad. They’re bigger and easy to flip through, like a real photo album.”


The app, which Facebook says is available in the Apple App Store now, also has a few new features for the iPad, including the ability to chat with friends, play Facebook games in full-screen mode, and watch high-resolution videos in the app.


Along with the iPad app launch, Facebook said Monday it has made several improvements to Facebook for iPhone and Facebook’s mobile website, m.facebook.com. “In your next update, you’ll see a simplified navigation, faster search and access to more games and apps,” Dubinsky wrote.


Here are some screenshots of Facebook for iPad (click to enlarge):


    


Square readies for battle with PayPal


Square COO Keith Rabois


Square is still an upstart in the mobile payment world but it’s showing that even with the approach of a new merchant payment system from PayPal this week, it’s got plenty of momentum on its side yet. The San Francisco start-up said today it’s up to $2 billion in annual payments processed and has activated 800,000 merchants for its payment system, up from half a million in May. And it’s made a key change in the way it process payments to appeal to larger merchants.


The news comes as PayPal prepares to show off a new in-store solution for merchants at its X.commerce Innovate developer conference that will place PayPal into direct competition with Square. PayPal has been a powerhouse online, but only recently has it set its sights on being a solution for in-store merchants and retailers, something Square is disrupting with its small mobile credit card swipe dongles and its new cashier and digital wallet software.


Square is trying to make sure that it stays ahead of some big names like PayPal, Google, Intuit and cellular carriers, who are looking at enabling more mobile payments and digital wallet tools. In that vein, Square said today it is lifting a limit on merchants that prevented some businesses from immediately receiving all the money they made beyond $1,000 in a week. Merchants had to provide additional verification and work with Square on case-by-case basis to cut back on the amount of time it took to receive the additional cash in their bank accounts. Now, the rule, which was originally instituted to combat fraud, has been set aside, which should be helpful in attracting larger business customers. It’s another gesture aimed at winning over merchants, like the transaction fee that Square discarded earlier.


The new rules are another sign that Square is prepping to compete hard in this space. COO Keith Rabois appeared at the GigaOM Mobilize conference last month and said we should expect some more services to roll out this month and in December. Rabois told TechCrunch that Square’s merchants now represent 10 percent of the merchants using Visa and Mastercard. And he told AllThingsD that 70 percent of Square users have never taken credit cards before.


Rabois has been really vocal about dismissing the challenge from PayPal, which he said has let its brand “atrophy.” But with PayPal finally wading into the much bigger market for in-store offline payments, it’s going to be interesting to see if it can take a bite out of Square. It sounds like there should be room as Square looks at smaller merchants while PayPal will likely tap existing customers and bigger retailers. But overtime, as each company’s ambitions grow, there’s going to be move overlap. Square, which raised $100 million earlier this year, continues to appear up to the challenge.


Orbitz outsources analytics to the cloud


Travel-booking service Orbitz has outsourced part of its big data strategy to the cloud  by selecting Kognitio’s Data Warehouse-as-a-Service offering. The decision to move such a critical piece of the analytics stack to Kognitio highlights Orbitz’s commitment to doing big data right, and is further proof that the cloud is an ideal place to do it.


DaaS, as Kognitio calls it this service, is a cloud-hosted version of the company’s WX2 in-memory, columnar row-based analytic database. In-memory analytics technology is particularly hot now, because it takes less time to process information stored in a system’s memory than it does information stored on a hard disk. That means companies can get closer to real-time analysis as data streams in, or far faster results when running less-timely queries. SAP and Oracle are also pushing in-memory database appliances.


“Before, it would often take days to get a handle on the data even before we could understand it,” Tony Gray, Orbitz’s director of business intelligence architecture and operations, said in a Kognitio press release. “Now our analysts can almost immediately use the data and drive analytics to find out things that they previously did not know, and use that knowledge to enable the creation of new, leading-edge travel products and solutions.”


Orbitz also uses Hadoop extensively, as detailed in this presentation from Hadoop World 2010. Hadoop serves as a complement to Orbitz’s data warehouse by letting the company store and process even data that might not make it into the Kognitio environment. That means Orbitz can undertake tasks not well-suited to an analytic database, such as machine learning and page download performance, that use various unstructured and not-overtly valuable data types.


That Orbitz chose Kognitio’ DaaS instead of buying either the software or an appliance is a validation for big data in the cloud. Not only does it take a lot of hardware and software licenses to store and process hundreds to thousands of terabytes, but maintaining and powering a big data system costs money, too. Although business models vary, any cloud-based, big-data offering eliminates these issues, while some solutions (but not Kognitio) even mitigate much of the need for data analysts by actually performing the analysis for customers.


That’s why, in some scenarios, big data seems like the killer app for cloud computing. Big data workloads are valuable, but not mission-critical in most instances. That means security concerns around storing data in the cloud might not be prohibitive, and big data systems are big enough and complex enough to justify paying someone else to manage them. Kognitio isn’t the first, nor will it be near the last, to realize this opportunity and capitalize on it.


Two (more) signs that our economy is in trouble


You and I don’t need to see charts to figure out that our economy is in deep trouble. Nevertheless, here are two that show that we are facing some headwinds and the impact of that is going to be felt in the tech economy as well. In a note to their clients this morning, Macquarie Capital’s research group pointed out:


Demand for power generation in the US (Y/Y growth in demand, excluding weather-related usage) has historically tracked closely with GDP growth and declines over the past several months suggest that GDP growth will remain muted, at least over the near term.



Similarly,


FedEx and UPS shipment trends represent another indicator of consumer purchasing behavior. Shipping volume fell off dramatically in both shippers’ largest segments during the last downturn in ’08-’09 (with a more rapid and deeper impact at FDX); domestic express volume growth turned negative at FedEx in the firm’s fiscal fourth quarter ’11 (ended April ’11) and continued to decelerate through the August quarter.


More importantly, FedEx cited a more cautious outlook for volume trends through the holiday season and into early 2012. Underpinning the weakening volume trends is a slowdown in consumer demand, particularly related to consumer electronics items manufactured in Asia and shipped to U.S. consumers. FedEx CEO Fred Smith’s quote from the call (on this year’s holiday shipping season): “We don’t anticipate a significant peak this year.”



FedEx/UPS data portends bad news in particular for e-commerce companies, which in turn can have reverberations through the rest of the tech ecosystem.


1/3 of consumers will spend more online than in-store this year


Despite the threat of online fraud, consumers are increasingly getting comfortable shopping online. ThreatMetrix, which provides a platform for preventing online fraud, and the Ponemon Institute, which researches data privacy and security, did some consumer surveys and found that one-third of the respondents said they plan on spending more online than they do in-store this year.


The willingness to shop doesn’t seem to be slowed down by worries about fraud, which are still significant. Almost three-fourths of respondents (72 percent) said they were “very concerned” or “concerned” about being a victim of online fraud, and 84 percent said they felt it was important for online payment services to protect them from fraud. The survey was conducted in August and polled 722 active Internet users.


“While consumers continue to show a preference for the convenience of shopping and browsing online, their concerns about becoming a victim of online fraud is also growing,” said Bert Rankin, VP of marketing, ThreatMetrix. “With mobile thrown into the shopping mix, which is even more apparent this year, consumers and retailers alike need to be well-equipped against fraudsters in every possible channel.”


Some highlights from the survey include:



  • 37 percent of shoppers will use a smartphone for holiday shopping, and 12 percent will use a tablet

  • 40 percent of Millennials believe fraud is lower when shopping on a smartphone or tablet

  • 32 percent of people have browsed a company’s Facebook page and then bought something on the company’s website

  • 20 percent have bought something directly through Facebook

  • 51 percent of respondents believe Google is more effective in combating fraud, compared to 26 percent for Facebook


Take a look at the infographic below:



Google’s Dart may be the code to make web apps shine


DartsGoogle today unveiled its effort to create a programming language solely for building web apps. Much like there’s a shift in computer hardware to take advantage of a more connected and mobile world, Google is attempting to push a concurrent shift in software.


Dart: What it is and what it isn’t


Google started building Dart last year under the name Dash, with the goal of making it easier to program web applications that run on servers inside a data center. The resulting language unveiled Monday is suggested to become a JavaScript killer, although we’ll have to see if it can take over the king of scripting languages and the lingua franca of bridging the static and dynamic programming divide on the web.


Google states its goals for Dart fairly clearly. The idea is to build a scripting language that can be built easily and quickly, but is also powerful enough to support a webscale applications and be maintained easily by more than just the author of the original code. The idea is that user-friendly languages like JavaScript allows a hobbyist-level developer to build out something quickly and easily, but the way the developer does writes the code can create hidden costs down the line as the application scales and requires more code and more people.


JavaScript requires a programmer to deliver a single chunk of unified code, whereas other languages such as Java and C++ allow for more modularity. Thanks to object-oriented programming, a programmer working with Java can reuse modules or previously written code to build a program. Other people can add to it and easily see how it was made. So where Java and other object-oriented programming are akin to building something with LEGO, JavaScript and other scripting languages are more like using paper-mache. In one, you can see what it is and how it was built in order to maintain or replicate it. In the other, you see the result but figuring out the underlying structure is almost impossible.


Fast is beautiful


Dart hopes to offer the ease of JavaScript coding with the modularity of object-oriented programming languages by using snapshots. In a post over at CNet, based on an interview with Lars Bak, the project leader for Dart, Bak explains a concept called snapshotting:


Google is evaluating the best way to integrate Dart directly into its Chrome browser, something Bak is keen on. One reason: it will enable a “snapshotting” technology that dramatically improves a Web app’s startup time. Snapshotting involves taking an application and “serializing” it into a single block of data.


In one test of snapshotting, a 55,000-line Dart program loaded in 60 milliseconds compared to 640 milliseconds without it, Bak said. A conventional JavaScript program would load in comparable time as Dart without snapshotting, he said. “I can see a lot of optimizations that’ll be applicable to Dart” when it’s integrated directly into a browser, he added.


Snapshots may also be the first hit of the Dart drug that gets developers addicted, if it can speed up load times like Bak says. So if Google integrates the Dart framework into its Chrome browser, that means that folks using Dart to build their web pages will see blazing fast load times while other sites wait for their JavaScript to load. Google still apparently plans to keep pushing JavaScript development in case Dart doesn’t catch developers’ eyes, but it’s clearly hoping it can continue pushing faster web pages for the modern computing era in a way that developers will latch onto. Axel Rauschmayer offers an in-depth post on why developers and browser makers might want to duck and avoid Dart.


But wait, there’s more!


Another stated goal of Dart is to build a framework that allows developer to code both the front end and the back in the same way. A new crop of languages and frameworks are being built, such as Node.js that allow this homogenous programming, because it makes life easier on developers., which combined with ease of building and maintaining code, and faster web sites, is just another way Google wants to entice developers into giving Dart a try.


Google is making the tools available via open source, which does show how committed Google is to pushing this out to the rest of the world. Google understands that any effort to rethink the underlying programming tools for web applications needs broad adoption from those building apps in their spare time to those hired to code for the Fortune 500. It also helps Google get in on the ground floor and potentially dominate a standards effort around what it hopes will become a standard for developing web-based applications.


So we’ll see Dart can deliver on the need for speed and the desire for a scripting language with the modularity of an object-oriented language. If it can, it may indeed be a JavaScript killer. Otherwise, it’s just another Google attempt to make the web faster by rethinking the way things are done.


Additional reporting by Cyndy Aleo.


What Wall Street is saying about Netflix’s Qwikster retreat


Netflix backtracked on its plans to separate its DVD-by-mail and streaming services and re-brand the DVD business Qwikster. So far, Wall Street analysts have been largely supportive of the move, although Netflix stock is down modestly in mid-afternoon trading after opening higher this morning.


Morgan Stanley analyst Scott DeVitt was mostly positive on the move, saying in a research note Monday that getting rid of Qwikster removes some short-term friction for Netflix customers who wouldn’t want to manage two separate accounts. It also lets Netflix continue to take advantage of its bundled offering. DeVitt wrote:


“By recanting its decision to create two semi-autonomous brands (one for DVD-by-mail and another for its growing streaming business), Netflix is not only showing its [subscriber] base a ‘good faith gesture’ but it is also back to leveraging one of its most powerful assets, its cross-platform recommendation algorithm. We believe this is a step in the right direction for the business model and should be viewed favorably by the market.”


JP Morgan analyst Doug Anmuth wrote in a research note that Netflix will be able to continue operating streaming and DVD businesses separately internally with the split being “mostly opaque to customers.” Anmuth also expects that the company will be able to turn things around after facing some short-term pain:


“We recognize that Netflix results will not turn around quickly and the company has lost a considerable amount of goodwill with consumers. However, we remain positive on the shares as we expect solid domestic growth to resume in 2012 once churn normalizes and we believe the stock assigns little credit for international potential going forward.”


“Subscriber attrition/churn likely continued to meaningfully worsen following the company’s mid-September pre-announcement that its [third quarter] ending subs would be 1 million lower than anticipated,” Stern Agee analyst Arvind Bhatia wrote in a research note Monday morning. Bhatia also wrote that the change in Netflix’s plans makes it unlikely that the company will sell off either its DVD or streaming businesses in the short term.


Ingrid Chung of Goldman Sachs disagrees with the assumption that Netflix saw additional churn as a reaction to the Qwikster announcement, instead believing the Netflix line that the about-face is due to a humbled management attempting to reduce “high friction” points and “mitigate the… lack of integration.” She wrote:


“We view this as a significant positive for the following reasons: (1) Better visibility into 4Q subscriber metrics –- if the company had gone ahead and divided the websites and customer queues, we believe they could have lost the majority of the 12 mn hybrid subscribers (representing roughly half of US subscribers) the company currently has. Todayʼs move means that the number of 4Q subscribers will be relatively similar to the number of 3Q subscribers; and (2)Management is listening to its customers (finally) and working to fix its relationship with customers.”


Photo courtesy of Flickr user Ross Catrow


Facebook acquires Q&A startup friend.ly


Facebook has acquired friend.ly, a Mountain View, Calif.-based startup that makes a Facebook app for asking and answering questions with other people on the social network. Financial terms of the deal have not been disclosed.


Mostly, the deal seems to be an acq-hire: The friend.ly app will continue to work as it always has, but going forward, friend.ly’s 10-person team will be working on new products at Facebook, friend.ly said in a blog post announcing the deal.


Friend.ly's team (click to enlarge)


Friend.ly was founded in 2010 and has reportedly raised $5 million in venture capital from Lightspeed Venture Partners, Balderton Capital and angel investors including Ron Conway and Jeff Clavier. Typical friend.ly questions are reminiscent of those asked on formspring.me, but they tend to be a bit tamer: “What would you take with you on a desert island?” and “Are long-distance relationships possible?”


Here’s Facebook’s statement on the deal:


We’re excited to announce that we recently acquired friend.ly, a Silicon Valley startup that created a really compelling way for people to express themselves and meet others through answering questions. We’ve admired the team’s efforts for some time now, and we’re looking forward to having Ed [Baker, friend.ly's CEO] and his colleagues make a big impact on the way millions of people connect and engage with each other on Facebook.