Data Warehousing, Business Intelligence and Predictive Analytics

Today, the performance and scale of nearly every data warehouse in production  is throttled — by its underlying storage infrastructure

XIO_iconsThe traditional work of data warehousing and business intelligence teams is difficult enough. Supporting the rapid growth of mainstream and mobile business intelligence, enabling hundreds of simultaneous BI users, asking complex business questions dozens of times a day, while also meeting the organization’s demand for more frequent data warehouse refresh cycles (typically 3-5 times per day) makes the decision about the storage layer of your data warehousing environments a critical architectural and operational choice. Today, the ability to add more users, more data and more BI functionality to a production data warehouse is usually limited by the performance of the underlying storage: something no database administrator, ultimately, can tune their way around.

And new demands on data warehouses — the addition of semi-structured textual data, real-time streaming data sets, IO-intensive predictive algorithms and statistical and non-statistical in-database analytics —  bring conventional enterprise storage and upstart hybrid arrays to their knees, compromising the entire data warehousing environment, and damaging the credibility of the IT organization with data-hungry end-users.

Modern data warehousing, business intelligence and predictive analytics require scalable, high-performance storage engines that are designed for the unique requirements of ultra high-volume query processing, and the particular methods that conventional relational database management systems (RDBMS) and text processing environments use to process queries against large volumes of structured and semi-structured data. High-performance query-intensive computing requires:

  • the right mix of flash storage  and fast-read/fast-write hard disk drives
  • automatic tuning of the storage performance for the actual query demand present at any moment in time, regardless of the limitations and gaps in the DBMS indexing strategies
  • built-in support, without manual tuning and intervention, for the simultaneous mixed workloads that characterize modern data warehouses: insert- and update-oriented extraction, transformation and loading (ETL) workloads, read/write-intensive query-oriented workloads, and the complex high-throughput “I/O storms” created by algorithmically-intensive statistical and predictive analyses.

What our customers say

“The X-IO ISE storage solution is competitive on a cost per TB basis and also provides us with high performance, 100% utilization and superior reliability. These benefits are then amplified by the five-year warranty provided by X-IO. We can expect at least a five year duration on all ISE systems and in some cases we have seen in excess of five years and uncompromised performance.”

“We have been able to draw a direct line between the level of performance we’re getting out of the ISE units and the performance we see at the application layer. It’s important to us that we were able to monitor and track that. In a lot of instances, with a lot of other vendors it is so abstracted in terms of what the performance actually means to the application.”

– Managing Director and CIO/Argus Information and Advisory Services

Conventional enterprise storage arrays, and integration-based hybrid storage arrays that depend on commodity hard drives for their capacity, cannot meet the rapidly-escalating demands for performance, throughput and capacity in modern data warehousing environments.

And those demands cannot be met economically by exotic alternatives like pure-SSD storage and in-memory database environments, both of which are responses to the failure of conventional enterprise storage arrays, rather than appropriate solutions to otherwise-unsolvable problems. Throwing millions of dollars in exotic hardware at a storage problem simply doesn’t make economic sense when cost-effective alternatives exist, and are proven to work as well or better than the exotic alternatives.

X-IO’s Intelligent Storage Element (ISE) is ideally suited for both conventional data warehousing and business intelligence environments, as well as leading-edge predictive and statistical analysis applications. The ISE’s Continuous Adaptive Data Placement (CADP) engine ensures, at every moment, that all in-demand BI data sets are resident in super-fast enterprise-grade solid state storage, while simultaneously providing the industry’s best serialized-read storage performance, for the table scans that, inevitably, appear in even the most carefully-tuned data warehouse workload. In X-IO environments, DBAs spend time adding new capabilities to the data warehousing environment, rather than attempting — often, with mixed success — to tune their way around intractable storage problems, and storage administrators spend their time working on other problems, rather than supporting frustrated DBAs.

The ISE’s patented self-healing storage features mean that data warehouses are never subject to unplanned downtime due to drive failures or data loss.

The ISE’s active-active mirroring capability allows organizations to run fault-tolerant data warehouse clusters: mirrored pairs of ISEs ensure that the data warehouses’s underlying data set is always available.

Our customers report, consistently, that ISEs:

  • reduce their wall-clock query response time from hours or minutes, to seconds;
  • allow them to update their data warehousing environments three or more times a day, while supporting hundreds of simultaneously active users during refresh cycles
  • reduce the running time of statistical and predictive applications by minutes or hours

all while:

  • reducing their storage footprint by 30-70%
  • eliminating the need for storage array servicing entirely
  • cutting their energy bills by 50% or more.

But don’t take our word for it, or theirs. In less than a day, we’ll install an ISE in your development or test environment, and let you pound it with your most damaging workloads. You’ll  watch your queries return in seconds, not minutes — with no changes to the data warehouse software environment whatsoever. Take our instant-acceleration test drive today.

Resources

© 2016 Xiotech Corporation. All right reserved. | X-IO Headquarters | 2375 Telstar Suite 150 | Colorado Springs, CO 80920 | Tel: 719.388.5500
Back to Top