Takeaway: The big data movement involves scraping third party websites for information, which can be in blatant violation of a site's copyright or Terms of Service.
Lesson Learned: Get your hands on the Terms of Service of the sites you wish to crawl. Decide what information you want to gather, how you want to use the data, and how often you need to collect it. Learn how to protect your own data with a prominent contract agreement.
[For more on this topic read: Everyone's Doing It, But Is It Legal?]
Becca Lipman is Senior Editor for Wall Street & Technology. She writes in-depth news articles with a focus on big data and compliance in the capital markets. She regularly meets with information technology leaders and innovators and writes about cloud computing, datacenters, ... View Full Bio