Automated real-time data extraction provides higher quality, comprehensive data
Any data you see in your web browser, from government and e-commerce to partner sites, social media and tons of other public websites, they all contain data that can add tremendous value to your analytics, intelligence, and information services. This includes local, state and federal statistics and compliance information, job listings, product catalogues, customer sentiment, competitive pricing, etc. The variety and volume of information is overwhelming and growing every day. Kapow automates Web Data Extraction with powerful transformation capabilities to ensure you get the right data at the right time and in the right format.
Featured Customer Success Stories for Web Data Extraction:
AGCO, the largest pure play, full-line agricultural equipment manufacturer, uses Kapow to automate web data extraction on hundreds of thousands of parts.
- AGCO's parts division needed to pull data from 10 websites, which sell AGCO parts as well as competitors' products.
- Their existing data feed was inflexible. They got infrequent data dumps, and AGCO had to do a lot of manual work on the product description lists.
- Overall not a very good or agile solution, given that they were extracting hundreds of thousands of parts in a very competitive industry.
- Kapow provides a fully automated data feed solution, including robots to pull from the 10 key websites and a hosted installation of Kapow running on Amazon EC2.
- Kapow also provides ongoing robot maintenance and support.
- An in-house deployment is planned for the next phase.
- Kapow eliminated manual work associated with web data acquisition.
- Competitive information is up-to-date.
AstraZeneca, one of the world's leading pharmaceutical companies, uses Kapow to automate web intelligence for executive reports and dashboards.
- To meet U.S. compliance requirements, pharmaceutical companies are required to maintain a Health Care Professionals (HCP) Exclusion List, showing HCPs that should be excluded from existing or new contracts.
- AstraZeneca wanted to automate existing manual processes for developing and maintaining the HCP Exclusion List.
- They used Kapow to create a master listing from information on external websites.
- The listing is automatically updated with specific regulated information.
- The process is integrated from delivery to a spreadsheet to a downstream compliance system.
- Data is integrated into an internal data mart built on Business Objects to create executive reports and dashboards.
- This is a major reporting system to the FDA, including all money spent for contracting outside HCPs and research organizations.
- After implementing the Kapow automated master web intelligence and matching process, the time to develop a list of possible suspects for non-compliant HCPs was reduced from 6 months to 2 weeks.
- AstraZeneca estimates that it could save millions of dollars in FDA fine avoidance with the improved compliance monitoring.
Attivio, a leader in unified information access, uses Kapow to automate web intelligence and integration with regulatory management systems.
- Attivio built a connector to their software so data output from Kapow workflows are automatically transformed into the correct format.
- Web data is collected automatically to support regulatory compliance.
- Based on their success with the financial company project, Attivio will be using Kapow workflows to automate web data extraction on 200 additional sites.
With Kapow, analysts and traders get real-time information on factors that affect trading price.
- In 2007, the EU introduced requirements for greater transparency in the utilities market.
- Organizations affected by the new regulations had to deliver hourly, daily and weekly reports online.
- Deutsche Börse wanted to capture this information in real time to inform trading decisions.
- With Kapow, they were able to extract and transform data in real time, providing analysts and traders with critical information affecting trading price.
- The solution retrieves information from 150 websites.
- Kapow was the only vendor who could fulfill the requirements in their timeframe.
- “With Kapow, we built powerful fundamental data models. Analysts and traders get critical factors that affect the price of a trade in real-time.” - Mario Schultz, Director, Market Data & Analytics, Deutsche Börse
With Kapow, the energy division of IHS can monitor thousands of sites for factors affecting supply and demand, without relying on offshore resources for web intelligence.
- The energy division of IHS needed to monitor thousands of government regulatory product vendor websites for factors that influence oil and gas supply and demand.
- They were relying on off-shore resources to access web data, reducing their control of what is a strategic aspect of their business.
- With Kapow's automated web data acquisition, they can gather and aggregate critical web information in real time without outsourcing.
- No coding or manual data extraction is required.
- Increased efficiency with automated data extraction.
- Enhanced and improved quality of master data.
- Enhanced product offerings based on better web data.
- Jobs2Web is the leading provider of interactive recruiting solutions.
- Kapow was able to build robots to extract information from several of the problem sites in minutes.
- The company now uses Kapow to automate web data extraction and integration.
- "With Kapow Technologies we are able to instantly pinpoint relevant matches among literally thousands that are buried in online job boards and automatically integrate this information into our system so our team of HR professionals can find the perfect job for Jobs2Web's clients." Ken Holec, CEO, Job2Web
- They needed to scale quickly.
- Kapow's visual scripting environment enabled the Live Matrix developers to scale quickly.
- Based on a successful POC involving 20 challenging sites, Live Matrix decided to move to Kapow for web intelligence.
- With Kapow's state of the art software, Live Matrix met their launch date and became the first TV Guide for the web.
Automating web data extraction was key to expanding business for PPG Industries, the world's leading provider of coatings and specialty products and services.
- An insurance company has outsourced its claims department to PPG. PPG handles claims requests from car owners through a call center application.
- PPG needs access to each insurance policy data, which typically resides on a mainframe.
- They are now encountering clients whose data resides in web applications. They need to automate web data extraction and integrate the data with internal systems to replace time consuming manual data processing by call center staff.
- Kapow robots perform web data extraction automatically.
- Robots are wrapped in web services, which make them easy to integrate into the existing solution.
- Automating web data extraction and integration will result in an estimated 50,000 additional cases from the insurance company.