HPCC Systems®open source Big Data processing platform proven to solve large or complex data challenges

Many insurance organizations have large volumes of data which has been collected and stored in massive datasets. These datasets need to be processed and analyzed to provide customer insight, business intelligence, marketplace trends, improve products and services for customers, or to meet other internal data processing requirements.

LexisNexis Risk Solutions, an industry leader in data content, data aggregation, and information services, developed and implemented the HPCC Systems platform as a solution for its own data-intensive computing requirements.

HPCC Systems is an open source, high performance cluster computing platform with unparalleled power, speed and scalability. Built on decades of experience by LexisNexis, HPCC Systems is enterprise proven and can process petabytes of data from thousands of data sources, with one programming language across the entire platform.

It is ideal for dirty data, and leverages graph analysis for fast processing of complex queries so more time can be spent on data exploration and making fast decisions.

As a result of the information explosion, many organizations now have the need to process and analyze massive volumes of data. These data-intensive computing requirements can be addressed by scalable systems based on hardware clusters of commodity servers coupled with system software to provide a distributed file storage system, job execution environment, online query capability, parallel application processing, and parallel programming development tools. The HPCC Systems platform provides all of these capabilities in an integrated, easy to implement and use, open source high performance computing environment.

HPCC Systems benefits include:

  • Conduct data integration on a scale on previously available. HPCC Systems is suitable for massive joins, mergers, sorts, transformations or tough N2 problems, which allow the detection of non-obvious relationships.
  • Have your data more quickly available for query and analysis. Gain competitive advantage by using your data to quickly identify trends, gain better customer insight or deliver products to market faster to help scale innovation and growth.
  • Lower your total cost of ownership (TCO) of Big Data solutions by eliminating expense legacy technology and licenses and using less resources to operate your mainframe with HPCC Systems with the HPCC Systems streamlined platform and consistent data-centric language.
  • The HPCC Systems platform scales linearly from tens to thousands of nodes handling petabytes of data and supporting millions of transaction per minute.
  • HPCC Systems is made up of three main components – the Data Refinery Cluster, the Data Query Cluster and the programming language called Enterprise Control Language (ECL).
  • The Data Refinery Cluster is responsible for consuming vast amounts of data, transforming, linking and indexing that data. It functions as a distributed file system with parallel processing power spread across the nodes. A cluster can scale from a single node to thousands of nodes.
  • The Data Query Cluster provides separate high-performance online query processing and data warehouse capabilities.
  • Enterprise Control Language (ECL) is the powerful programming language that is ideally suited for the manipulation of Big Data.
  • ECL IDE is a modern IDE used to code, debug and monitor ECL programs.
  • For more technical information, please visit www.hpccsystems.com