Data Management

12:24 PM
Melanie Rodier
Melanie Rodier
Commentary
Connect Directly
Facebook
Google+
LinkedIn
Twitter
RSS
E-Mail
50%
50%

Wall Street Scratches Its Head Over Big Data Challenge

With IT budgets growing less than 1%, firms are scrambling to deal with a huge challenge.

The data challenge is a juggernaut, and Wall Street firms whose budgets are virtually flat these days, are scrambling to figure out how to deal with it.

An effective strategy will recognize the importance of big data and include an investigation of the requirements to ingest, index and integrate structured and unstructured, streaming and static data from a variety of sources, Robert Desautels, CEO, President and Founder, Harvard Research Group, said at yesterday’s High Performance Computing Linux for Wall Street conference.

[For more on the big data challenge, read Five Things To Know About Big Data.]

Here are a few figures that were bandied around at the event:U.S. securities message rates have been growing 30% every 6 months over the last decade, according to Larry Tabb from TABB Group.

Data volume is set to expand 800% in the next five years. Unstructured data grows 10 to 50 times faster than structured data, Jean Staten Healy, director, WW Cross-IBM Linux and Open Virtualization, IBM Corp., noted.

In the meantime, data is getting more social. There is a 42% growth per year in internet-connected devices, Healy said. A staggering 1.2 zetabytes of data (1.2 trillion gigabytes) exists in the digital universe.

The big problem for Wall Street is that IT budgets are growing less than 1%. As a result, organizations are scrambling to get to grips with the data challenge as cost-effectively as possible.

“We’ve had to optimize how to maximize the efficiency of the grid. There are opportunities to leverage sharing of compute resources across lines of business,” Dino Vitale, Director, Morgan Stanley Cross Technology Services, pointed out.

For IBM, the data challenge means looking at how to build smarter networks. “We’re building some that are based on open flow. It allows us to manage network elements remotely by allowing the controller to push policies to each individual switch,” said Stewart Raphael, business development executive, IBM System Networking, IBM Corp.

Above all, the three most important things firms grappling with the big data challenge should focus on are infrastructure, platform, and visualization, Larry Ryan, financial services industry CTO, HP, suggested.

Melanie Rodier has worked as a print and broadcast journalist for over 10 years, covering business and finance, general news, and film trade news. Prior to joining Wall Street & Technology in April 2007, Melanie lived in Paris, where she worked for the International Herald ... View Full Bio
Comment  | 
Print  | 
More Insights
More Commentary
4 Factors Driving Enlightenment & Big-Data Adoption in Regulatory Compliance
Whether seeking to maintain compliance or to drive business value, emerging technologies can unleash tremendous potential.
The Art of Leveraging Governance, Risk & Compliance Technology Tools
Eliminating compliance risk across information channels is a constantly transforming task. Ongoing auditing and auto-corrective technology can increase trust, accountability, and transparency.
The FSB's Swaps Data Aggregation Report, a Technical Review
The Report discusses legal, technological, and regulatory issues to be resolved in order to obtain a complete view of swap transactions around the world.
Raising the Data Management Stakes
Data management can get firms only so far. Advanced data analytics is needed for all business lines and for calculating risk, especially with BCBS 239 on the horizon.
Asia/Pacific Challenged by T+2 European Settlement Cycle
A survey commissioned by Omgeo shows market participants in Asia/Pacific are ill prepared for Europe's T+2 settlement deadline in October.
Register for Wall Street & Technology Newsletters
White Papers
Current Issue
Wall Street & Technology - Elite 8, October 2014
The in-depth profiles of this year's Elite 8 honorees focus on leadership, talent recruitment, big data, analytics, mobile, and more.
Video
5 Things to Look For Before Accepting Terms & Conditions
5 Things to Look For Before Accepting Terms & Conditions
Is your corporate data at risk? Before uploading sensitive information to cloud services be sure to review these terms.