<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>TEST Magazine</title>
	<atom:link href="http://www.testmagazine.co.uk/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.testmagazine.co.uk</link>
	<description></description>
	<lastBuildDate>Fri, 11 May 2012 13:58:51 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.3.2</generator>
<xhtml:meta xmlns:xhtml="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
		<item>
		<title>Cloud testing for an Agile world</title>
		<link>http://www.testmagazine.co.uk/2012/05/cloud-testing-for-an-agile-world/</link>
		<comments>http://www.testmagazine.co.uk/2012/05/cloud-testing-for-an-agile-world/#comments</comments>
		<pubDate>Fri, 11 May 2012 13:58:28 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[Current Issue]]></category>
		<category><![CDATA[Features]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4404</guid>
		<description><![CDATA[Always at the cutting edge of IT, Silicon Valley in California is now the epicentre for using the cloud for load and performance testing for today&#8217;s Web and mobile world. SOASTA’s Fred Beringer reports. The Internet has revolutionized the way we conduct business, consume information and interact with each other. For some businesses, the Internet [...]]]></description>
			<content:encoded><![CDATA[<p><strong><img class="alignright size-medium wp-image-4405" title="http://www.dreamstime.com/-image22019108" src="http://www.testmagazine.co.uk/wp-content/uploads/2012/04/Cloud-Data-Cover_xl1A3FF70-300x207.jpg" alt="" width="300" height="207" />Always at the cutting edge of IT, Silicon Valley in California is now the epicentre for using the cloud for load and performance testing for today&#8217;s Web and mobile world. SOASTA’s Fred Beringer reports.</strong></p>
<p><strong>The Internet has revolutionized the way we conduct business, consume information and interact with each other. For some businesses, the Internet has become the primary source of revenue and the main customer-facing outlet for communicating, advertising and brand management. Applications have become an aggregation of content, information, data, and media, while the architecture has become more complex, and more dependent on external third parties. The Web and the mobile Web have forever changed the application landscape requiring a new emphasis on load and performance testing.</strong></p>
<p>These changes can be seen everywhere today. Massive amounts of data are being stored and accessed, and online applications have to adapt to this growth. In parallel, the behaviour of Internet users is becoming increasingly event-driven. Applications will often need to serve a much larger than normal customer base for perhaps a few weeks or sometimes just a few critical hours. We’re seeing an increasing unpredictability in traffic patterns as social media outlets, such as Facebook and Twitter, can drive more traffic to a web site than it’s prepared to handle. A company will spend millions of dollars creating engaging content and running promotional campaigns to draw users to its site. But if the site crashes, or response time crawls, all that energy and money will be wasted. Even public perception of the company could be seriously downgraded.</p>
<p>This unpredictability must be taken into consideration when shaping up a performance testing strategy.</p>
<p>&nbsp;</p>
<p><strong>Four key requirements for effective performance testing</strong></p>
<p><strong>1. Scale:</strong> The test must simulate a realistic volume of user traffic. Optimally, simulating at minimum the average number of users expected to use the application on a daily basis. But not only the average! There is also a need to test for unexpected traffic spikes. If the web site or application is accessed from all parts of the world, the test must replicate global traffic. Businesses need to understand the local performance of their website, as some parts of the world might generate more revenue than others. In general, they want to optimise some of those high revenue locations.</p>
<p>To generate a high volume of concurrent users with traditional performance testing tools requires a substantial investment in hardware. To reduce costs, often the testing is diverted to a small subset of the production environment. Tests are done on a small scale and the results are extrapolated to peak production numbers. This is problematic for a number of reasons. The lab is significantly different from production in terms of hardware, scale, configuration, and activity at any given time (batch jobs, shared services, etc). Perhaps more critical is the fact that real users come from outside of the firewall where latency is an important factor in the customer experience.</p>
<p>While important for extracting some type of results, testing in the lab cannot answer questions about production performance or capacity with a high degree of accuracy and confidence.</p>
<p><strong>2. Speed:</strong> Websites can change every day, and even hourly for the largest e-commerce outlets, and all have an effect on performance. Software development builds happen multiple times per day, releases to customers happen frequently and the rate of change is high. Without agile test practices and the right tools, applications may leave development without being tested, or worse, the testing itself will slow down the release process. All processes and tools need to be able to adapt to this fast paced software development lifecycle.</p>
<p>Lack of speed and reactivity is the main inhibitor to agility.</p>
<p><strong>3. Real-time results for actionable intelligence:</strong> The first objective of performance testing is to gather relevant data from every component involved in the overall performance the application under test. This is raw and dumb data.</p>
<p>A performance test will end up with LOTS of data, easily generating terabytes of data. But it’s USELESS data if there is no mechanism to transform the data into actionable information. In order to deal with this “big data” problem, results need to be aggregated and displayed in real-time. Performance engineers want to be able to answer questions such as:</p>
<p>•              What is the relationship between the number of virtual users and the memory consumed by the application server?</p>
<p>•              How much server capacity is left with when reaching 10,000 concurrent users during the test?</p>
<p>•              What is the correlation between the numbers of process counts on the database server and the overall throughput?</p>
<p>•              At what stage during the test is there a drop in overall response time? Is it possible to correlate this drop with other data to understand this behaviour?</p>
<p>•              What is the correlation between an increase in response time and the number of errors coming from the SSL Server?</p>
<p>•              Why is 90 percent of response time for the overall homepage taken by this particular file? Where does it come from? Why does it take longer than the other page assets?</p>
<p>Traditional performance testing approaches have always struggled with analytics. To combine, aggregate, and correlate these performance results requires high computing power. Performance engineers are typically left doing their analysis offline and manually with a high potential for human error and ultimately low confidence with the result.</p>
<p><strong>4. Cost:</strong> This is a key inhibitor for performance testing excellence. Initial hardware investment is very high, as is the subsequent maintenance cost. Testing organisations have to deal with memory and CPU upgrades, and operating system and disk maintenance. Investment in dedicated and skilled IT people to handle the environment is not cheap. Plus three years after the initial investment, hardware is obsolete, and the requirement for load has become so much higher.</p>
<p>What’s the answer?</p>
<p>&nbsp;</p>
<p><strong>Cloud testing &#8211; performance testing for today&#8217;s world</strong></p>
<p>Cloud testing was born based on cloud computing’s promises, and today means a fast, scalable and affordable approach to test web or mobile applications using cloud computing</p>
<p>Specifically, leveraging the Cloud to do this type of testing yields a number of benefits:</p>
<p>•              Tests can be achieved at a level only observed on production systems. Typically companies will want to test at 100 percent of typical traffic levels but cloud testing allows them to test at 150, 300, 500 percent! Using cloud resources, they’re able to generate from hundreds to millions of users.</p>
<p>•              It is possible to generate a realistic and geographically dispersed load. Today’s online world requires real-world traffic.</p>
<p>•              It is possible to test both inside and outside the firewall, which brings the most efficient and effective results.</p>
<p>•              The cost of tests is definitely lower because businesses can rent the hardware and only pay for actual usage.</p>
<p>•              It allows testers to respond to fast development cycle times by making agile performance testing a reality.</p>
<p>•              For the first time, performance tests can run in production. This is the only way to gain full confidence in the application.</p>
<p><strong>Continuity between testing in the performance lab, in a staging environment and in production</strong></p>
<p>Historically, because of scale and lack of real-time results, companies were always testing at a fraction of the expected load in a dedicated performance lab, and then extrapolating results to gain confidence that their live site would be able to handle the load. Not a very good practice, but they had no other choice. They have an alternative today as cloud testing brings them everything they need to test in production.</p>
<p>Scale introduces the potential for chaos. The number of elements, from hardware to software to network, that can impact performance grows exponentially as an application scales and the inter-dependencies between the various components grow increasingly complex. Testing at scale and in production requires an infrastructure to support the traffic, a means to manage the deployment and execution of the test, and analytics that can massage the massive amounts of data and deliver actionable information. Of course, performance engineers with the experience to navigate through complex environments are required as well.</p>
<p>&nbsp;</p>
<p><strong>Testing in the performance lab</strong></p>
<p>Ongoing performance testing in a lab allows engineering teams to assess performance degradation or improvement over time, and helps catch any show-stopping performance bugs before they reach production. The issues found are inherent to the application itself such as:</p>
<p>•              Memory leaks;</p>
<p>•              Inefficient database schema or queries;</p>
<p>•              Garbage collection issues;</p>
<p>•              Bad CPU consumption;</p>
<p>•              Slow pages.</p>
<p>Tests in the lab are absolutely necessary and don’t require a large load to identify issues and bottlenecks within the application itself.</p>
<p>&nbsp;</p>
<p><strong>Testing in a staging environment</strong></p>
<p>A staging environment brings you closer to production-like circumstances and allows you to perform important tests such as verifying capacity, establishing correct configuration, stressing available resources and verifying performance expectations.</p>
<p>The issues you’ll find and fix are a level higher and cross the application and the infrastructure. It will allow you to find issues such as:</p>
<p>•              Bad configuration settings;</p>
<p>•              Slow third-party plug-ins;</p>
<p>•              Auto-scaling failures;</p>
<p>•              Security bottlenecks;</p>
<p>•              Inadequate server resources;</p>
<p>•              Low database thread counts.</p>
<p>There are still limitations such as availability of the environment and exclusion of key components, but it tests closer to full scale.</p>
<p>&nbsp;</p>
<p><strong>Testing in production</strong></p>
<p>Testing in production is the best way to get a true picture of capacity and performance in the real world. Testing in production is the only way to ensure that online applications will perform as expected and certify them in normal and extreme conditions by testing them beyond expected limits. There are many issues you will catch that cannot be found when testing in a lab or in a staging environment:</p>
<p>•              Latency between systems;</p>
<p>•              Bad network configuration;</p>
<p>•              Low network bandwidth;</p>
<p>•              Bad load balancer configuration settings;</p>
<p>•              Firewall max capacity;</p>
<p>•              Bad CDN file placement;</p>
<p>•              Wrong DNS routing;</p>
<p>•              Unbalanced web servers;</p>
<p>•              The effect of batch jobs running in the background.</p>
<p>&nbsp;</p>
<p><strong>Cloud testing is meant for the agile world</strong></p>
<p>Performance engineering organisations have struggled in the past due to the inertia created by their dependence on a fixed hardware environment. It is difficult to rapidly deploy a reasonable number of servers. Without real-time results, it’s impossible to provide quick turn-around of information. Cloud testing changes the game because it is so flexible, scalable and adaptable that you can run your tests for every build, every change in your store inventory, every change in your operational infrastructure, at any time, at any scale.</p>
<p>&nbsp;</p>
<p><strong>Test performance through the whole application life cycle</strong></p>
<p>All the various types of performance tests are feasible and they can be run in the development stage where low volume testing is needed, all the way to production at full scale. Here are just a few types that you can run:</p>
<p><strong>Baseline:</strong> the most common type of performance test. Its purpose is to achieve a certain level of peak load on a pre-defined ramp-up and sustain it while meeting a set of success criteria &#8211; usually acceptable response times with no errors.</p>
<p><strong>Spike:</strong> simulates steeper ramps of load, and is critical to ensuring that an application can withstand unplanned surges in traffic, such as users flooding into a site after a commercial or email campaign. A spike test might ramp to the baseline peak load in half of the time, or you may initiate a spike in the middle of steady state of load.</p>
<p><strong>Endurance:</strong> helps ensure that there are no memory leaks or stability problems over time. These types of tests typically ramp up to baseline load levels, and then run for anywhere from two hours to 72 hours to assess stability over time.</p>
<p><strong>Failure:</strong> ramps up to peak load while the team simulates the failure of critical components such as the web, application, and database tiers. A typical failure scenario would be to ramp up to a certain load level, say 25,000 concurrent users, and while at steady state the team would pull a network cable out of a database server to simulate one node failing over to the other. This would ensure that failover took place, and would measure the customer experience during the event.</p>
<p><strong>Stress:</strong> finds the breaking point for each individual tier of the application, or for isolated pieces of functionality. A stress test may focus on hitting only the home page until the breaking point is observed, or it may focus on having concurrent users logging in as often as possible to discover the tipping point of the login code.</p>
<p><strong>Diagnostic:</strong> designed to troubleshoot a specific issue or code change. These tests typically use a specially designed scenario outside of the normal library of test scripts to hit an area of the application under load and reproduce an issue, or verify issue resolution.</p>
<p>&nbsp;</p>
<p><strong>Real-time performance analysis</strong></p>
<p>Not only does cloud computing help generate load, it also brings enough computer power to be able to compute performance results in real-time. By receiving, absorbing and understanding the data, it is possible to make decisions and take actions. For example, if the environment is experiencing a surge of traffic going into one web server, the performance engineer is able to see the full performance picture coming not only from the application but also from the whole infrastructure. He is able to identify quickly any bottlenecks. In that particular case, it could be a misconfiguration in a load balancer sending too much traffic to one particular web server.</p>
<p><strong>Continuous performance testing</strong></p>
<p>One of the challenges with continuous testing, whether it is for functional or performance testing, is to have a suitable environment of the right size, ready to run tests at all times. The investment is difficult to justify. Tests won’t consume 100 percent of the hardware capacity, and spare cycles are difficult to use for other purposes as the environment needs to remain clean. Cloud computing offers a fresh environment every time a test is run. As soon as the setup is performed there is no need to worry about it for a very long time!</p>
<p>&nbsp;</p>
<p><strong>Test from all locations</strong></p>
<p>Relying on a central data centre to generate load doesn’t account for true global traffic. Leveraging a grid provided by a cloud computing vendor with a global presence reflects global deployment. If the application is accessed from the US, Europe and Asia, generation of user load coming from all these locations will give a true and realistic picture of performance. This is an increasingly important factor for companies doing business on the Internet, as they want to understand the impact of distributed traffic on their application.</p>
<p>&nbsp;</p>
<p><strong>Encourage collaboration between teams</strong></p>
<p>The fact that organisations are able to get results in real-time and take action, allows the test to be run in a very collaboratively way. Imagine having developers, testers, DBAs, IT people, all in the same room watching a test run, being able to discuss results, and making changes in real time. That’s the real way of doing performance testing.</p>
<p>With traditional performance testing, companies had to wait days to get a fairly accurate picture of the application’s performance. There was a gap in the discussion. And the usual question from developers or operation people was: “Go run the test again, it can’t be right.” By having a way to test and get results in real-time, the discussion keeps going. DBAs can make changes to their database queues on the fly, IT can make change to their load balancer in real-time as the test is running. Real-time results are conversation enablers, which is the cornerstone of any Agile organisation.</p>
<p>&nbsp;</p>
<p><strong>Fred Beringer</strong></p>
<p><strong>Vice president business development</strong></p>
<p><strong>SOASTA</strong></p>
<p><a href="http://www.soasta.com" onclick="return TrackClick('http%3A%2F%2Fwww.soasta.com','www.soasta.com')" target="_blank">www.soasta.com</a></p>
<p>&nbsp;</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/05/cloud-testing-for-an-agile-world/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>The ultimate test bed?</title>
		<link>http://www.testmagazine.co.uk/2012/05/the-ultimate-test-bed/</link>
		<comments>http://www.testmagazine.co.uk/2012/05/the-ultimate-test-bed/#comments</comments>
		<pubDate>Fri, 11 May 2012 13:56:45 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[Editor's Blog]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4483</guid>
		<description><![CDATA[It’s testing, but not as we know it. Associated Press reports that a site in New Mexico, near the city of Hobbs in Lea County, has been chosen as location for a new city which we are told will be crammed with all the latest mod cons, smart technology, gadgets and gizmos, the very odd [...]]]></description>
			<content:encoded><![CDATA[<p><strong>It’s testing, but not as we know it. Associated Press reports that a site in New Mexico, near the city of Hobbs in Lea County, has been chosen as location for a new city which we are told will be crammed with all the latest mod cons, smart technology, gadgets and gizmos, the very odd part is there will be no one there to enjoy these fruits of man’s ingenuity as the billion-dollar ghost town which is to be built by US firm Pegasus Global Holdings will be used purely as a research facility to allow developers, technologists, scientists and other assorted boffins to test various cutting edge and hi-tec items including, so it is reported, self-flushing loos, intelligent traffic systems, smart grids and first responder tech for homeland security.</strong></p>
<p>CITE will reflect an ordinary mid-sized American city including urban, suburban and rural areas with all the necessary roads, buildings, water, telecommunications and operating systems required. It will cover 15 square miles with the initial investment of around $400m (£249m) expected to rise to $1bn. Pegasus expects the project to create 350 new direct jobs and around 3,500 indirect jobs in the region. Building work is expected to start on june 30 this year.</p>
<p>The city will be used to run large-scale tests on new technology well away from the general public . Projects so far mooted include next generation wireless networks, which can be tested and assessed without monopolising the public’s valuable bandwidth, and self-driving cars&#8230; The reasons for testing them well away from the public don’t need explaining!</p>
<p>There was no information about whether – or indeed how many &#8211; software testers would be needed for the project, but we aren’t predicting a software testers’ gold rush just yet.</p>
<p><strong>Matt Bailey</strong></p>
<p><strong>Editor</strong></p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/05/the-ultimate-test-bed/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Widely used encryption software broken with Fuzzing Cloud</title>
		<link>http://www.testmagazine.co.uk/2012/05/widely-used-encryption-software-broken-with-fuzzing-cloud/</link>
		<comments>http://www.testmagazine.co.uk/2012/05/widely-used-encryption-software-broken-with-fuzzing-cloud/#comments</comments>
		<pubDate>Fri, 11 May 2012 13:34:35 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[Products]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4480</guid>
		<description><![CDATA[Automated security testing tools vendor Codenomicon Ltd has announced that it has helped identify a critical flaw in widely-used encryption software. A flaw in the OpenSSL handling of CBC mode ciphersuites in TLS 1.1, 1.2 and DTLS can be exploited in a denial of service attack on both client and server software. The flaw was [...]]]></description>
			<content:encoded><![CDATA[<p><strong>Automated security testing tools vendor Codenomicon Ltd has announced that it has helped identify a critical flaw in widely-used encryption software. A flaw in the OpenSSL handling of CBC mode ciphersuites in TLS 1.1, 1.2 and DTLS can be exploited in a denial of service attack on both client and server software. The flaw was found with Codenomicon&#8217;s new cloud-based testing platform, Fuzz-o-Matic.</strong></p>
<p>The TLS security protocol is the current Internet standard for encrypting and authenticating application traffic. TLS is used by millions of people every day in online banking, e-commerce, email, and Voice-over-IP applications. The OpenSSL is an open-source implementation of TLS and is employed in standard operating systems, web browsers, email clients, and network devices ranging from WiFi access points and DSL modems to industrial-strength core routers.</p>
<p>“Cloud-based security testing is the future of outsourced penetration tests, and this is clear proof of the success of Fuzz-o-Matic”, said Antti Häyrynen, senior security reseacher and the lead developer of the Fuzz-o-Matic platform.</p>
<p>OpenSSL team issued acknowledgements to Codenomicon for discovering this issue using Fuzz-o-Matic fuzzing as a service testing platform.</p>
<p>Fuzz-o-Matic is a platform that can run both Codenomicon Defensics and a wide range of other fuzzing tools and platforms available in the industry. The users of Fuzz-o-Matic upload their software to the cloud-based service, where the leading experts of the industry choose and configure all tools and start the tests. Fuzz-o-Matic customers will get email notifications on all found vulnerabilities, and can login into the system to download test results.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/05/widely-used-encryption-software-broken-with-fuzzing-cloud/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Fuzzing web applications – The new web auditing</title>
		<link>http://www.testmagazine.co.uk/2012/04/fuzzing-web-applications-the-new-web-auditing/</link>
		<comments>http://www.testmagazine.co.uk/2012/04/fuzzing-web-applications-the-new-web-auditing/#comments</comments>
		<pubDate>Fri, 27 Apr 2012 10:20:59 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[Current Issue]]></category>
		<category><![CDATA[Features]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4402</guid>
		<description><![CDATA[Fuzz testing is a new way to approach web application testing. It is more focused on DoS level problems and it is suited particularly well to finding previously unknown vulnerabilities in software. Codenomicon web security experts Rikke Kuipers and Miia Vuontisjärvi explain. It goes without saying that society as it is these days is heavily [...]]]></description>
			<content:encoded><![CDATA[<p><strong>Fuzz testing is a new way to approach web application testing. It is more focused on DoS level problems and it is suited particularly well to finding previously unknown vulnerabilities in software. Codenomicon web security experts Rikke Kuipers and Miia Vuontisjärvi explain.</strong></p>
<p><strong>It goes without saying that society as it is these days is heavily dependent upon the current IT infrastructure and IT in general. Large networks such as the internet and all the interconnected devices forming these became part of the critical infrastructure, on which even lives are dependent. Not surprisingly, security has been a big point for decades.</strong></p>
<p>Traditionally, the focus of IT security has been on protecting the network infrastructure and the operating system itself, on a kernel level that is. Attackers would try to inject their own messages in lower level protocol communication or initiate these themselves, and thus effectively ‘control’ the network traffic.</p>
<p>A game changer was the introduction of cryptography in the 90s, which could now provide data confidentiality, data integrity, and authentication. Basic security was hereby provided by the network and transport layer of the OSI model, and later by the application layer though the use of SSL/TLS.</p>
<p>&nbsp;</p>
<p><strong>Introducing the web applications</strong></p>
<p>However, the global internet made rapid growth in both size and technological perspective and was not just used for exchanging data anymore, but now offering services through web-based applications. A browser engine will use client side technologies such as (D)HTML, Java, JavaScript, Flash, Silverlight to render static content and on the webserver server side technologies like ASP, ASP.NET, CGI, ColdFusion, JSP/Java, PHP, Perl, Python and so on will be used to render dynamic content and perform tasks a normal desktop application would do as well.</p>
<p>Modern web applications store, edit and retrieve dynamic content, and use databases and/or fileservers for these purposes. A browser sends the request to the server side technology in use, the application processes it, queries a database and if needed returns information to the end user. Large web applications usually consist out of multiple webservers, database clusters, web application firewalls and interact with huge data storage facilities.</p>
<p><strong> </strong></p>
<p><strong>New attack vector</strong></p>
<p>After years of extensive testing the network infrastructure and the devices connected to these have become more resilient to lower protocol attacks, and it requires more resources to find new vulnerabilities. The focus has shifted towards the application layer, which has proven to be a very effective attack vector in recent times. Desktop applications have been the target for a long time, but it seems as if web applications have taken over the stick.</p>
<p>Web applications inherit the same weaknesses as desktop applications, the effects bad coding practices can have need no further explanation. However, a whole new range of possible attack vectors have been introduced. Normally the handling of sessions between users are serviced by the operation system, but in the case of web application these have to be initiated and destroyed by the server side technology in use. The same goes for authentication to services, in web applications usually done against databases or services similar to LDAP.</p>
<p>One of the reasons for the immense popularity of web applications as a target among attackers is the fact that these are usually permanently online and reachable from any computer connected to the Internet. The servers which these applications run on and talk to are not uncommonly connected to internal networks, and thus an easy way to evade firewalls, IDSs and IPSs. Traffic originating from webservers towards a database server is usually trusted, since it’s assumed to be controlled by the web application.</p>
<p><strong> </strong></p>
<p><strong>Web application vulnerabilities</strong></p>
<p>Numerous articles have been written about typical web application vulnerabilities, such as code injection techniques. In SQL injection, for example, an attacker would try to input SQL statements in a web form to have the web application perform operations on the database other than the ones intended by the designer. Another example is cross-site scripting, which allows attackers to bypass client-side security mechanisms normally imposed on web content by modern web browsers and thus directly attack another user of the same application by stealing session cookies, or performing operations in the name of the victim, more commonly known as cross-site request forgery.</p>
<p>These techniques are built upon knowledge of client and server side technologies in use, and exploit known flaws in application logic.</p>
<p><em> </em></p>
<p><strong>Fuzz testing web applications</strong></p>
<p>Research conducted in our labs has shown that it is time to take a step back and look at web applications for what they actually are: just applications with an interface to the Internet. While it is very important to perform static code analysis and traditional web application pen testing to root out any known flaws, new vulnerabilities will never be found by these tools and techniques. To root out unknown bugs, we have found that fuzzing does the job.</p>
<p>Contrary to traditional web application penetration testing, fuzz testing is not aware (and does not care much) for application logic, and does not try to exploit any known vulnerabilities. It just feeds the system with malformed input to find abnormal responses that indicate a possibly exploitable vulnerability in software.</p>
<p>Fuzzing web application has proven to be much harder than traditional robustness testing which we have been conducting for more than ten years. Instead of just one attack interface which we target using one protocol, we now face multiple interfaces with an almost infinite combination of client and server side technologies used, talking to a very wide variety of databases and file servers all using their own specific (query) language</p>
<p>&nbsp;</p>
<p><strong>What to fuzz?</strong></p>
<p>The first challenge when fuzzing a web application is to decide what to fuzz. Since there is no specification or existing model of the messages used by the application, each session will be different depending upon how the user interacts with the application. What we can do is record a session using a browser, and base our models on the message sequences found therein. These messages can be fuzzed and replayed back to the application just as we would do in a normal fuzzing session. The effectiveness of this approach will unfortunately always be limited to the data recorded while browsing through the web application, any vulnerability outside the recorded session is not found during the fuzz tests.</p>
<p>In the beginning of 2011 Google released their “HTTP Archive” tool (HAR) as part of the Google Chrome developer tools, used to record browsing sessions. Included in these packages are all the requests to and from the web application, including cookie information. The idea behind this is to allow effective processing and analysing data coming from various sources by external tools, such as WebApp fuzzer. The information saved in these HAR files proved to be perfect to base fuzz test models upon.</p>
<p>After walking through a web application in Chrome, the HAR file can be exported and imported in the WebApp sequence creator which will show all the sequences found. The more interesting messages are automatically selected as candidates for fuzzing and replaying. Interesting messages would be requests and replies containing query parameters, cookies, POST payload. These fields will be anomalised, together with all the HTTP header fields present in the request. In the picture below we can see the HTTP request indicated with the red arrow which will be used for anomalisation, and the blue arrow indicating the matching HTTP response. The less interesting requests, greyed out, are requests for CSS files, pictures and the like.</p>
<p>The WebApp suite starts sending the malformed requests and broken sequences to the web application. The following screenshot shows an example of a malformed POST message; the malformed part of the message is marked red.</p>
<p>Once the anomalies are sent to the system under test, we try look for unexpected replies, which would indicate that our injected packet triggered a malfunction and thus found a vulnerability. This brings us to the second challenge of fuzzing web applications.</p>
<p><strong> </strong></p>
<p><strong>Detecting faults</strong></p>
<p>Detecting problems is not always self-evident. A test case which triggers a crash-level bug is easy to identify due to the discontinuation of a service or process, but a test case which causes the application to overwrite database records or configuration files on the webserver is less obvious.</p>
<p>This obstacle can be overcome by using external instrumentation. Before, during and after each test case there is the option to use external scripts to determine what exactly happened on the application, database and fileservers. All of these components can be loaded in a memory and I/O profiler, effectively monitoring syscalls for suspicious writes. Apart from that, log files can be read after each test case checking for interesting lines.</p>
<p>Based on the findings, vulnerable code can now be patched, or sent to the appropriate vendors for patching.</p>
<p><strong> </strong></p>
<p><strong>Conclusion </strong></p>
<p>Fuzz testing is a new, unique way to approach web application testing. It is more focused on DoS level problems and it suits particularly well in finding previously unknown vulnerabilities in software.</p>
<p>However compared to the traditional protocol fuzzing, web application fuzzing is more challenging. Since there is no existing model or specification, the test cases have to be created based on recordings. Walking through larger web application can create HAR files with thousands of unique requests, and with 30.000 test cases per request as it is now, this might be very time and resource consuming to test. The crawling through web applications can be automated, similar to what bots currently do to index pages for search engines. Nevertheless, vulnerability outside the recorded session will not be discovered.</p>
<p>Despite the challenges and limitations, we have already found numerous flaws from large applications. We have every reason to believe that fuzz testing complemented with traditional penetration testing and static code analysis will be the future of web application testing.</p>
<p>&nbsp;</p>
<p><strong>Rikke Kuipers</strong></p>
<p><strong>Security Specialist</strong></p>
<p><strong>Codenomicon</strong></p>
<p><strong><a href="http://www.Codenomicon.com" onclick="return TrackClick('http%3A%2F%2Fwww.Codenomicon.com','www.Codenomicon.com')" target="_blank">www.Codenomicon.com</a></strong></p>
<p>&nbsp;</p>
<p><strong>Miia Vuontisjärvi</strong></p>
<p><strong>Security analyst</strong></p>
<p><strong>Codenomicon</strong></p>
<p><strong><a href="http://www.codenomicon.com" onclick="return TrackClick('http%3A%2F%2Fwww.codenomicon.com','www.codenomicon.com')">www.codenomicon.com</a></strong></p>
<p>&nbsp;</p>
<p><strong>About Rikke Kuipers</strong></p>
<p>Rikke Kuipers is a Dutch native with a background as a senior network engineer at several large ISPs. Since joining Codenomicon, Rikke has conducted security audits and done security research in the field of network and web application security.</p>
<p>&nbsp;</p>
<p><strong>About Codenomicon</strong></p>
<p>Codenomicon develops proactive software security testing and situation awareness tools which find software bugs. Defensics is a fully automatic security testing bundle for over 200 communication interfaces. Situation awareness tools collect, filter, and visualise network and abuse information concurrently. Governments, leading software companies, operators, and manufacturers use Codenomicon&#8217;s solutions.</p>
<p>&nbsp;</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/04/fuzzing-web-applications-the-new-web-auditing/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Will the Raspberry Pi spark a programming revolution?</title>
		<link>http://www.testmagazine.co.uk/2012/04/will-the-raspberry-pi-spark-a-programming-revolution/</link>
		<comments>http://www.testmagazine.co.uk/2012/04/will-the-raspberry-pi-spark-a-programming-revolution/#comments</comments>
		<pubDate>Fri, 27 Apr 2012 10:20:00 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[News]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4470</guid>
		<description><![CDATA[The Raspberry Pi is a credit-card sized computer that plugs into any TV plus a keyboard which the makers – a Cambridge-based charity – want to see “being used by kids all over the world to learn programming”. The idea for a tiny and cheap computer for kids came in 2006, when Eben Upton and [...]]]></description>
			<content:encoded><![CDATA[<p><strong>The Raspberry Pi is a credit-card sized computer that plugs into any TV plus a keyboard which the makers – a Cambridge-based charity – want to see “being used by kids all over the world to learn programming”.</strong></p>
<p>The idea for a tiny and cheap computer for kids came in 2006, when Eben Upton and his colleagues at the University of Cambridge’s Computer Laboratory, became concerned about the year-on-year decline in the numbers and skills levels of the A Level students applying to read Computer Science. “From a situation in the 1990s where most of the kids applying were coming to interview as experienced hobbyist programmers, the landscape in the 2000s was very different; a typical applicant might only have done a little web design,” he commented.</p>
<p>The Cambridge colleagues observed that something had changed the way that kids were interacting with computers. A number of problems were identified: the colonisation of the ICT curriculum with lessons on using Word and Excel, or writing webpages; the end of the dot-com boom; and the rise of the home PC and games console to replace the Amigas, BBC Micros, Spectrum ZX and Commodore 64 machines that people of an earlier generation learned to program on.</p>
<p>The makers describe the Raspberry Pi as “a capable little PC which can be used for many of the things that your desktop PC does, like spreadsheets, word-processing and games. It also plays high-definition video.”</p>
<p>As for the OS and programming language: “We’ll be using Fedora as our recommended distribution. It’s straightforward to replace the root partition on the SD card with another ARM Linux distro if you want to use something else. The OS is stored on the SD card. By default, we’ll be supporting Python as the educational language. Any language which will compile for ARMv6 can be used with the Raspberry Pi, though; so you’re not limited to using Python.”</p>
<p>Computing at School is writing the user guide and programming manual, but others are already seeing the potential of the Raspberry Pi. “We’re aware of a few books being planned and written around the Raspberry Pi,” says the maker, “and others have already started to produce some excellent tutorials including video. We’re also working with partners to use it as a teaching platform for other subjects, including languages, maths and so on. Once we launch, we hope that the community will help bodies like Computing at School put together teaching material such as lesson plans and resources and push this into schools. In due course, the foundation hopes to provide a system of prizes to give young people something to work towards.”</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/04/will-the-raspberry-pi-spark-a-programming-revolution/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Testing export success</title>
		<link>http://www.testmagazine.co.uk/2012/04/testing-export-success/</link>
		<comments>http://www.testmagazine.co.uk/2012/04/testing-export-success/#comments</comments>
		<pubDate>Fri, 27 Apr 2012 10:18:29 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[News]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4468</guid>
		<description><![CDATA[TestPlant, the developer of robotic test tool product eggPlant, has been named runner-up in the UK’s National Challenge: Exporting for Growth London Prize. The company’s chief executive George Mackintosh accepted the award from Lord Green, Trade and Investment Minister at a cceremony in London in February. The award also secures grants for UK Trade &#38; [...]]]></description>
			<content:encoded><![CDATA[<p><strong>TestPlant, the developer of robotic test tool product eggPlant, has been named runner-up in the UK’s National Challenge: Exporting for Growth London Prize. The company’s chief executive George Mackintosh accepted the award from Lord Green, Trade and Investment Minister at a cceremony in London in February. The award also secures grants for UK Trade &amp; Investment (UKTI) support and advice to help the continued growth of TestPlant’s export business.</strong></p>
<p>Mackintosh commented: &#8220;Being recognised for this award is great news for TestPlant, especially given the calibre of the other finalists. As well as promoting and supporting our export drive, this is also a huge stamp of approval for eggPlant in the UK &#8211; a core market for software innovation and design. The help from UKTI and sponsors HSBC and PwC will be used to accelerate our expansion into India and China. The whole process has been of real business benefit to us.”</p>
<p>Parveen Thornhill, regional director for UKTI London, added: “The standard of entries was incredibly high and the creativity and innovation of the ideas was fantastic.”</p>
<p>Since it was founded in 2008, TestPlant has seen year-on-year success with an average compound annual revenue growth rate of over 80 percent. In the last year alone it has achieved a 104 percent growth rate. Today 85 percent of its sales are to export markets, including America, Canada, China and India. This latest recognition complements existing awards and plaudits from the British Venture Capital Association and the London Export Awards. The company’s other market-firsts include becoming the only company in its market niche with a patented technology, secured in 2011 from the US Patent and Trademark Office for eggPlant, its intelligent robotic software testing tool.</p>
<p>“The recognition of this UKTI Export for Growth prize reinforces our position as a market leader and innovator, and also reflects the global demand for automated software testing and validation,” concludes Mackintosh. “TestPlant is the fastest-growing business in this sector which is driven by the increasing software complexity and the diversity of devices such as smartphones and tablets, which are making the testing of business critical applications fast-paced, consumer-facing and ever more important.”</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/04/testing-export-success/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Finland has the cleanest computers in the world</title>
		<link>http://www.testmagazine.co.uk/2012/04/finland-has-the-cleanest-computers-in-the-world/</link>
		<comments>http://www.testmagazine.co.uk/2012/04/finland-has-the-cleanest-computers-in-the-world/#comments</comments>
		<pubDate>Fri, 27 Apr 2012 10:17:17 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[News]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4466</guid>
		<description><![CDATA[Statistics recently published by forensics malware tools vendor Norman ASA show that Finland is the safest country in the world in terms of malware infections. The statistics are also backed up by a Microsoft regional threat assessment report from last year, as reported by MSNBC. According to the report, in general, Finland is thought to [...]]]></description>
			<content:encoded><![CDATA[<p><strong>Statistics recently published by forensics malware tools vendor Norman ASA show that Finland is the safest country in the world in terms of malware infections. The statistics are also backed up by a Microsoft regional threat assessment report from last year, as reported by MSNBC.</strong></p>
<p>According to the report, in general, Finland is thought to be ‘mostly harmless’ in terms of cyber security: thanks to a collaboration between security community, CERT-FIs and Finnish ISPs, there are relatively few attacks originating in Finland. CERT-FI and other similar actors handle vast volumes of incident report data information with AbuseHelper. Codenomicon has expanded the toolset to Abuse Situation Awareness, gaining fully automated sharing of actionable incident data and situational awareness over malicious activity.</p>
<p>As a long-standing homeland for internationally acclaimed security companies, Finland has a strong cyber security culture which shows in the recent studies. Cyber threats are taken seriously, which has resulted in R&amp;D efforts to create better security. This has ultimately led to the creation of many international companies working with cyber security software.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/04/finland-has-the-cleanest-computers-in-the-world/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>30+ regional specialist software quality jobs to be created</title>
		<link>http://www.testmagazine.co.uk/2012/04/30-regional-specialist-software-quality-jobs-to-be-created/</link>
		<comments>http://www.testmagazine.co.uk/2012/04/30-regional-specialist-software-quality-jobs-to-be-created/#comments</comments>
		<pubDate>Fri, 27 Apr 2012 10:16:12 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[News]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4464</guid>
		<description><![CDATA[Software quality specialist SQS Software Quality Systems has announced a recruitment drive for its UK Central and Northern Region, which covers all of the Midlands and the North of England. This expansion has been driven by what the company says is sustained success across the area. It is currently recruiting experienced software quality engineers, software [...]]]></description>
			<content:encoded><![CDATA[<p><strong>Software quality specialist SQS Software Quality Systems has announced a recruitment drive for its UK Central and Northern Region, which covers all of the Midlands and the North of England. This expansion has been driven by what the company says is sustained success across the area. It is currently recruiting experienced software quality engineers, software testing managers, performance engineers and software test analysts for its Manchester and Birmingham offices.</strong></p>
<p>Dave Rigler, director of Central and Northern Region at SQS, said: “There is now widespread acceptance that quality testing is a necessary strategic investment in any IT project so choosing the right people to carry out this work is essential. At SQS, we deliver software quality services to a wide range of customers across the UK, including major financial institutions, telecommunications companies and Government bodies as well as high-tech and gaming organisations.</p>
<p>“Our 2012 recruitment drive across Central and North England is the result of business needs and the pipeline of activity that we are gearing up for in 2012. It will offer those seeking a new career in the software quality sector an amazing opportunity to work with the best consultants in the field. These latest jobs are specialist roles that will ideally suit professionals currently working in the sector or looking to transfer relevant skill sets into this growth industry.”</p>
<p>For more information on vacancies at SQS, and the application process, visit <a href="http://www.sqs.com" onclick="return TrackClick('http%3A%2F%2Fwww.sqs.com','http%3A%2F%2Fwww.sqs.com')" target="_blank">http://www.sqs.com</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/04/30-regional-specialist-software-quality-jobs-to-be-created/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Germany gets a Cloud Testlab</title>
		<link>http://www.testmagazine.co.uk/2012/04/germany-gets-a-cloud-testlab/</link>
		<comments>http://www.testmagazine.co.uk/2012/04/germany-gets-a-cloud-testlab/#comments</comments>
		<pubDate>Fri, 27 Apr 2012 10:14:33 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[News]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4462</guid>
		<description><![CDATA[Cloudgermany.de has announced that it will house its Cloud Testlab within Interxion’s Frankfurt data centre. According to the company, the proof-of-concept test environment allows service providers and system integrators to test and develop cloud services at high speed and with best-in-class performance guarantees. By locating its platform at Interxion, Cloudgermany combines the performance of its [...]]]></description>
			<content:encoded><![CDATA[<p><strong>Cloudgermany.de has announced that it will house its Cloud Testlab within Interxion’s Frankfurt data centre. According to the company, the proof-of-concept test environment allows service providers and system integrators to test and develop cloud services at high speed and with best-in-class performance guarantees.</strong></p>
<p>By locating its platform at Interxion, Cloudgermany combines the performance of its native cloud software and state-of-the-art Infrastructure as a Service platform with the connectivity, high availability, and reliability of Interxion’s Frankfurt data centres. Cloudgermany.de offers its services in full compliance with German data protection rules.</p>
<p>Between 1 March and 30 April 2012, companies can try Software as a Service solution – including Microsoft Windows Server® – via a trial account in a secure environment in real time for free. Additionally, users can migrate their own applications onto cloudgermany.de’s infrastructure, such as CRM or ERP systems, and test the performance. The customer doesn’t even have to worry about basic parameters like memory, server capacity, data centre capacity, or data backup as all elements are provisioned as a service by cloudgermany.de. Instead, the enterprise customer can fully concentrate on its core business and allocate IT resources accordingly.</p>
<p>The cloudgermany.de platform can also be replicated at all of Interxion’s data centres across eleven European countries, which provide equally high-performance environments for enterprise applications. Interxion data centres do not only offer the highest safety and availability, but also direct access to other companies based within the data centre, including service providers, systems integrators, connectivity providers, and the Internet Exchange DE-CIX.</p>
<p>“With the establishment of the Cloud Testlab, we would like to make it easier for medium-sized companies in particular to take the first step toward cloud computing by offering them all the programs and applications they already use on a daily basis on the cloudgermany.de infrastructure platform. Thus we enable them to dynamically tailor IT infrastructure to fit fluctuations in demand and to avoid engineering to meet peak demands. We have been using Interxion’s infrastructure since May and have had no downtime so far,” commented Udo Würtz, advisor of the management board at cloudgermany.de.</p>
<p>Peter Knapp, German managing director at Interxion, added, “The rapid adoption of cloud computing has seen cloud-based services become a central part of business strategy. The launch of this Cloud Testlab reinforces our commitment to the cloud and offers both customers and prospects the opportunity to test and develop cloud services at high speed and with best-in-class performance guarantees.”</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/04/germany-gets-a-cloud-testlab/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>QA Systems buys Cantata++ business from IPL</title>
		<link>http://www.testmagazine.co.uk/2012/04/qa-systems-buys-cantata-business-from-ipl/</link>
		<comments>http://www.testmagazine.co.uk/2012/04/qa-systems-buys-cantata-business-from-ipl/#comments</comments>
		<pubDate>Fri, 27 Apr 2012 10:13:15 +0000</pubDate>
		<dc:creator>matthewbailey</dc:creator>
				<category><![CDATA[News]]></category>

		<guid isPermaLink="false">http://www.testmagazine.co.uk/?p=4460</guid>
		<description><![CDATA[QA Systems GmbH, a Stuttgart-based provider of software development solutions, says it has purchased the Testing Products Business Unit from UK IT services company IPL, thereby launching QA Systems Ltd. IPL’s Testing Products Business Unit, based in its head offices in Bath, was responsible for the development and worldwide partner network that distributed the C/C++ [...]]]></description>
			<content:encoded><![CDATA[<p><strong>QA Systems GmbH, a Stuttgart-based provider of software development solutions, says it has purchased the Testing Products Business Unit from UK IT services company IPL, thereby launching QA Systems Ltd. IPL’s Testing Products Business Unit, based in its head offices in Bath, was responsible for the development and worldwide partner network that distributed the C/C++ and Ada embedded systems unit and integration testing tools Cantata++ and AdaTEST.</strong></p>
<p>Having seen an increasing demand for testing products for business and safety-critical components and embedded systems, QA Systems says it saw an opportunity to combine IPL’s dynamic testing tools with its current portfolio of requirements engineering and static testing tools. In order to do so freely and determine the direction of research and development activities, QA Systems has purchased the entire Testing Products Business Unit from IPL and set up QA Systems as a result – an independent UK-based company with a global remit predominantly targeting the aerospace, defence, automotive, engineering and healthcare sectors.</p>
<p>Andreas Sczepansky, CEO and president of QA Systems, comments, “A historical focus on static testing has limited our market reach. However, having seen the market potential of IPL’s dynamic testing software products, we were keen to be able to combine these product lines with our own so that we could go to market with an all-encompassing proposition. In order to maintain control over the ongoing development so that it would suit our needs and ambitions, we decided that the most practical option would be to offer to purchase the business unit from IPL and establish a new UK-based company from the existing resource.”</p>
<p>The employees, intellectual property and assets previously held within IPL’s Testing Products Business Unit are being transferred to the newly-established QA Systems Ltd, which will also be based in Bath. All existing customers of AdaTEST and Cantata++ products will continue to be supported by the new entity and will benefit from the greater resources of the overall QA Systems group. Existing partners already reselling the two product lines will also continue to be supported by QA Systems Ltd. Indeed, as part of its global strategy, QA Systems Ltd. is actively seeking out further additional partners to assist in territorial and vertical market reach.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.testmagazine.co.uk/2012/04/qa-systems-buys-cantata-business-from-ipl/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

