Risk Management

11:37 AM
Connect Directly

SEC Technology Roundtable: How To Test Your Software To Avoid Technical Glitches

During the SEC's market technology roundtable, GETCO CTO Jonathan Ross argued that market participants must follow several testing best practices to avoid technical glitches.

Watch Wall Street & Technology and Advanced Trading’s live video analysis of this morning’s roundtable at 1pm EST: here.

The technical errors that have recently befallen Knight Capital, BATS and Nasdaq causing chaos to the markets are not the result of complexity or fragmented markets, but the result of basic technology 101 issues, SEC chairperson Mary Schapiro said today during the agency’s market technology roundtable.

During the SEC discussion, Dr Nancy Leveson, professor of aeronautics and astronautics and engineering systems, MIT, argued that software errors will always happen. The financial industry, like the aviation industry, needs solutions beyond technology – which must include strong regulation.

“ Most industries have government agencies overseeing with an iron hand. The aircraft industry knows people will stop flying if planes start falling out of the sky. You cannot build an unsinkable ship or unfailable software. If you engage in hubris and wishful thinking, you will have to suffer the consequences,” Leveson said.

Still, GETCO CTO Jonathan Ross argued that in order to avoid technical glitches, firms must follow several testing best practices: These include having independently designed systems, he said.

“ To the extent possible, systems should be independent from other systems to limit the potential for an error or failure to cascade to other systems,” he said, adding that any changes to systems must be small, incremental and frequent to reduce the magnitude of any errors and make it easier to mitigate the impact of such errors if they do occur.

Ross also suggested using layered, redundant risk measures, with multiple, overlapping levels of preventive or protective risk controls that each look at a system independently.

GETCO has a formal process for testing its software, Ross noted. This includes a testing lab, testing protocols that developers follow, and change management processes, he wrote in a statement for the SEC.

“Development and testing should reinforce each other; continuous building and testing gives developers a strong feedback loop,” he said.

In the development cycle, common approaches to software testing firms should follow include unit testing – or tests of discrete, generally small, specific and functional, components of the system.

Best practices should also include regression testing, or tests built specifically to address a bug previously identified and to prevent the reintroduction of that bug and integration testing, or system tests designed to test the interaction of applications with each other or outside parties.

Melanie Rodier has worked as a print and broadcast journalist for over 10 years, covering business and finance, general news, and film trade news. Prior to joining Wall Street & Technology in April 2007, Melanie lived in Paris, where she worked for the International Herald ... View Full Bio

Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
User Rank: Apprentice
12/5/2012 | 5:28:39 PM
re: SEC Technology Roundtable: How To Test Your Software To Avoid Technical Glitches

Jonathan Ross is correct. Assumptions and interactions
are verified quickly in small, frequent, incremental deployments.
G«ˇIron fistedG«÷
government agencies will drive firms to infrequent, large, G«ˇbet the farm and
cross your fingersG«÷ updates. Firms will live with more problems, for longer
periods of time, while they wait for infrequent G«ˇone true bug fix releasesG«÷. Ultimately,
the risk of large problems will grow as a result.

Register for Wall Street & Technology Newsletters
White Papers
Current Issue
Wall Street & Technology - Elite 8
The in-depth profiles of this year's Elite 8 honorees focus on leadership, talent recruitment, big data, analytics, mobile, and more.
Inside Abel Noser's Trading Floor
Inside Abel Noser's Trading Floor
Advanced Trading takes you on an exclusive tour of Abel Noser's New York trading floor, where the agency broker known for transaction cost analysis, is customizing algorithms for the buy side, while growing its fixed income trading and transitions business.