Deep Dive 1.0

DeepDive is a trained data analysis system developed by Stanford that allows developers to perform data analysis on a deeper level than other systems. DeepDive is targeted towards developers who are already familiar with Python and SQL, notes the DeepDive website.

The Twitter Search API searches against a sampling of recent Tweets published in the past 7 days.

DeepDive analysis

DeepDive is a trained data analysis system developed by Stanford that allows developers to perform data analysis on a deeper level than other systems. DeepDive is targeted towards developers who are already familiar with Python and SQL, notes the DeepDive website.

Unlike traditional systems, DeepDive works well with noisy or imprecise data resulting from misspellings and human mistakes. It is also able to extract large amounts of data from numerous sources that include millions of PDF files, websites, documents and more. Developers are able to write simple rules to inform the system’s learning process based on their knowledge of a domain, and DeepDive’s “distant” training ability means developers do not need to provide training for every prediction. According to Stanford’s DeepDive website, the system uses a high-performance learning and inference engine thanks to cutting-edge techniques.

DeepDive analysis has been used for both broad and specific domains, and it is particularly effective in scientific applications such as those used for geology and paleobiology. DeepDive has also collaborated with Wikipedia to create Wisci, which enriches the online information database with structured data.

The Twitter Search API is part of Twitter’s REST API. It allows queries against the indices of recent or popular Tweets and behaves similarly to, but not exactly like the Search feature available in Twitter mobile or web clients, such as Twitter.com search. The Twitter Search API searches against a sampling of recent Tweets published in the past 7 days.