Comments
Richard Davies wrote: The UK has a good crop of technology pioneers in cloud computing - for example ElasticHosts, FlexiScale, Flexiant, OnApp - and also some strong government initiatives such as G-Cloud. We will have to see whether this kind of technical leadership converts into swift mass-market adoption or not.
Cloud Expo on Google News

SYS-CON.TV
Cloud Expo & Virtualization 2009 East
PLATINUM SPONSORS:
IBM
Smarter Business Solutions Through Dynamic Infrastructure
IBM
Smarter Insights: How the CIO Becomes a Hero Again
Microsoft
Windows Azure
GOLD SPONSORS:
Appsense
Why VDI?
CA
Maximizing the Business Value of Virtualization in Enterprise and Cloud Computing Environments
ExactTarget
Messaging in the Cloud - Email, SMS and Voice
Freedom OSS
Stairway to the Cloud
Sun
Sun's Incubation Platform: Helping Startups Serve the Enterprise
POWER PANELS:
Cloud Computing & Enterprise IT: Cost & Operational Benefits
How and Why is a Flexible IT Infrastructure the Key To the Future?
Click For 2008 West
Event Webcasts
WebZinc
Cool import

Shortly before this magazine was launched, I was sent a product announcement for something known as WebZinc. The first thing I noticed about it was that the company producing it, White Cliff Computing Ltd., was in Yorkshire, England. "That can't be a very common place for software companies to be based," I thought to myself. "I'll have to work them into the queue once we get rolling." Three years later, here they are!

The delay was due to the year we spent getting ready to produce this magazine. During that time, the CD for the software got buried under a ton of junk in my office, only to surface two years later while I was looking for something else. "Oh," I thought, "guess I'm a bit late on this one."

The good news is that the software fit a specific need I had at the moment I re-discovered it. I had a private Web site that I wanted to harvest large amounts of information from. No access to the back-end database was available so I faced "screen scraping" large amounts of data off the site. Thankfully, WebZinc let me drag all the information I wanted off the site in less than 10 lines of code!

It started with the install. It was a standard "take all the defaults" installation that I liked. I noticed that the assem-bly for the library wasn't part of the GAC, so I figured it must be in the installation directory, which was in the "Program Files" folder named "WebZinc .NET," and yes, the assembly was right there. This is a perfect installation default, as far as I'm concerned.

I created a normal C# Console Application, added a reference to the Assembly, and tried to code against the library without looking at the documentation. The main object, as I quickly discovered, is called WebZinc, and it has a default constructor that accepts the URL of the page you want to begin scraping - a very logical, easily discovered design!

At this point, I had to start consulting the documentation a little. It was very straightforward and easy to read though. To fill out the login form on the first page, I just referenced the Form sub-property of the CurrentPage property on my WebZinc object, assigning values to the Value properties of each of the InputFields contained in it. Finally, as I guessed without looking at the documentation, you call the Submit method on the Form and get back another Page. Easy!

I carried on in this fashion for another five lines of code or so and, at that point, I had written a single iteration through my target Web site to gather all the info I wanted. All I had to do now was encapsulate my code in a loop, gather up the rest of the pages on the target site - which were in same format, just different content - and write a database back-end to store my results. None of this was directly related to WebZinc, though, so I'll spare you the details.

Bottom line: if you are looking to write a piece of software that interacts with a Web site designed for humans in any kind of automated fashion, you must check out WebZinc! You could do the same things with the low-level networking features built directly into .NET, but WebZinc provides a model that's much higher-level and better suited to dealing specifically with Web content. It'll save you days and days of programming if used properly.

Product Information

WebZinc
White Cliff Computing Ltd
The Grange
Tursdale, Durham, DH6 5NU.
Phone: 07092 17 18 19 (UK) or +44 1666 511 527 (outside the UK)
Fax: 07092 131 141
Sales: support@webzinc.net
Price: $199 for the upgrade, $399 for the full license
About Derek Ferguson
Derek Ferguson, founding editor and editor-in-chief of .Net Developer's Journal, is a noted technology expert and former Microsoft MVP.

In order to post a comment you need to be registered and logged in.

Register | Sign-in

Reader Feedback: Page 1 of 1

Latest Cloud Developer Stories
Can you bring services from the cloud to your customers faster and have them adopt it with ease of use or bring the power of bundled services to the fingertips of your clients without creating new rigid ‘apps stove pipes'? Do you want to prevent your business running away to publ...
OCZ Technology Group, a provider of high-performance solid-state drives (SSDs) for computing devices and systems, on Tuesday announced the Z-Drive R4 CloudServ PCI Express (PCIe) flash storage solution, designed to accelerate cloud computing applications and reduce operating expe...
Many organizations have embraced, or are considering, the benefits of cloud computing – speed, flexibility, increased expertise, shared workload, reduced costs, etc. The benefits are many – but so are the risks. What are the threats to cloud security? Which parties assume respons...
In August 2011, SHI Enterprise Solutions (ESS) division launched the SHI Cloud, offering reliable and cost-effective industrial-grade cloud computing platforms. That same division achieved an 82 percent increase in revenue over 2010.
SoftLayer Technologies on Tuesday announced the immediate worldwide availability of SoftLayer Object Storage, a redundant and highly scalable cloud storage service that allows users to easily store, search and retrieve data across the Internet, with optional CDN connectivity, or ...
Subscribe to the World's Most Powerful Newsletters
Subscribe to Our Rss Feeds & Get Your SYS-CON News Live!
Click to Add our RSS Feeds to the Service of Your Choice:
Google Reader or Homepage Add to My Yahoo! Subscribe with Bloglines Subscribe in NewsGator Online
myFeedster Add to My AOL Subscribe in Rojo Add 'Hugg' to Newsburst from CNET News.com Kinja Digest View Additional SYS-CON Feeds
Publish Your Article! Please send it to editorial(at)sys-con.com!

Advertise on this site! Contact advertising(at)sys-con.com! 201 802-3021

SYS-CON Featured Whitepapers
ADS BY GOOGLE