Data Trends: Petabyte and Beyond

By Fred Hapgood
Tue, October 15, 2002

CIO — Suppose you came to work one day, took off your jacket, loosened your tie, sat down and found a letter on your desk from corporate counsel advising you that a court has just ruled that corporations are now responsible for retaining all business-related phone conversations for one calendar year.

Under this letter is a memo from the PR department (labeled URGENT) advising you that marketing’s plan to use face recognition technology to identify prime customers entering the store may be getting some negative reviews in the press, with phrases like invasion of privacy and Big Brother being tossed around.

And under that is a directive from management asking for a technical analysis of a market simulator that may be able to predict to 5 percent accuracy the response to a new product of single parents between the ages of 29 and 33 living in Illinois suburbs with incomes in the third decile.

Who are you? You’re a petabyte CIO, the person responsible for developing and maintaining the science-fiction-like applications that will be running on tomorrow’s immense storage capacities. Currently, petabyte responsibilities are mostly restricted to the IT departments of universities, research organizations, and microbiology and genetics labs. But the law of technological adoption ("If you build it, they will use it") says that sooner or later most CIOs will be crossing that line, discovering a new world of applications, responsibilities, costs and problems. So it’s time to start thinking about...

Petabyte Power

Petabyte levels of storage will make possible three new categories of applications. One group depends on retaining and processing vast amounts of visual data, especially data from video cams. Imagine cameras trained on the sales floor, recording the minute-by-minute flow of customer traffic. Imagine that data feeding an application that analyzes the relative effectiveness of a given product placement or the impact of a markdown. Marketing might be interested in learning how the proportion of couples to singles entering the store changes during the course of a two-week promotional campaign, or at what time of day the number of women shopping with kids rises and at what time it falls. With petabyte levels of storage, HR will be able to crunch a few months’ worth of video camera data to flag personnel responsible for traffic bottlenecks on the sales floor.

A second category of petabyte potential is in supporting the transition to device networks. If the first generation of networks connected people to data and to each other, the second will do the same with both physical (counters, meters, cameras, motors, switches, telephones, digital printers) and virtual devices (applications and program objects). The great virtue of device networks is that they allow any interested constituency to have remote access to any link in the production cycle. CNN, for example, is digitizing and networking all its production equipment so that pagers, cell phones, PDAs, desktops and websites will all have equal, continuous and simultaneous access to programming.

Continue Reading

Enterprise storage has undergone many changes in recent years - with converged storage and infrastructure 2.0 paving the way for reduced IT infrastructure costs and greater performance. This report discusses the latest trends that are setting the stage for the next era of computing. Learn about the new infrastructure and storage trends that are changing the way business storage works today.
As the role of IT increases within organizations, the need to move data when and where it is needed is critical to support emerging business requirements. This has become increasingly difficult due to the huge growth of data volumes. This white paper sponsored by HP + Intel evaluates a solution that aims to enable the movement of data without physical limitations. Read now and see how this could enable agility and efficiency.
HP X9000 IBRIX Storage Systems powered by Intel (circle R) Xeon (circle R) processors allow users to create a virtual file storage environment where they can match storage price/performance with application requirements, yet manage a single, highly scalable system. All three appliance models (X9300 Gateway, X9320, and X9720), or multiple instances of them, can coexist within a single namespace. This gives users the ability to manage various types of storage with different performance profiles as storage pools in a single file system that scales to 16PB and to 1,024 nodes, providing shared storage resources that can grow, contract, and be optimized with uninterrupted data access.

The key to meeting this goal is the X9000 IBRIX scale-out file system software. In combination with these tuned hardware nodes, this software allows organizations to scale independently across multiple dimensions (capacity, I/O performance, throughput) while managing the entire content pool as a single entity. The advantages to this approach include: reduced management staff overhead, highly tunable and scalable capacity and throughput levels, rapid system expansion and upgrade, continuous and real-time view of the past with IBRIX Snap, and reliable and usable data retention.
Learn how small and midsized businesses are increasingly adopting virtualization to deliver consolidation, improve data back up and disaster recovery and increase security with an in-depth new paper from the Enterprise Strategy Group.
This paper covers power utilization, intelligent power management and industry best practices for energy efficiency. Extreme Networks® takes a lifecycle approach to power efficiency, management and recycling, offering savings to our customers and promoting a greener world.
With increasing data growth, comes increased need for data security.  The existing DLP model, with a focus on compliance/enforcement is not sufficient as the data discovery and classification capabilities are not granular enough.  Read this paper to find how you can efficiently and accurately manage your risk by rapidly inventorying and classifying your data and then developing remediation workflows that support business needs. 
Archiving and Backup are the foundation of the next generation of information governance. However, commodity data protection tools and basic archives are only good for storing data. In the changing IT landscape, understanding what you are keeping, when to delete, and delivering insight to the business from your data is the future of these systems. Join us to hear the impact of private and public cloud solutions, "big data" and your choices while market evolves.
Have you been looking to hear about customer's experiences with the new VMware vCenter Site Recovery Manager product? View this webcast to learn about VMware customer, Navicure, and their experiences testing and evaluating the recovery manager, their progress in implementing it in their environment and their advice other customers considering using vCenter.
Virtualizing business-critical applications is an essential step in your journey to the cloud. Microsoft SQL Server, Exchange and SharePoint, and Oracle applications, are often the backbone of business IT. The benefits of virtualizing these applications extend far beyond mere consolidation. Understanding how VMware improves quality of service and agility while reducing costs will help you make the case for taking virtualization to the next level in your company.
Applications are changing - they're increasingly web-oriented, global in nature and run from multiple device types. Additionally, the volume of data is growing exponentially every year. How do you ensure your applications have fast, accurate, up-to-date information in this new world? Modern applications are data-intensive; delivering data the old way using monolithic databases isn't working. What's needed is a modern approach to data. One that scales-out as needed and delivers predictable high performance, but without sacrificing data consistency or integrity.
Real-time, global data updates have become a critical business requirement for financial-services firms. Overnight or hourly batch jobs can cause erroneous results and missed opportunities. New regulatory requirements dictate real-time reporting of liquidity; traders want access to real-time market and risk positions; and the time windows for relevancy of cross-selling and marketing opportunities are getting shorter. To deal with these issues and new requirements, firms need to be able to react quickly to changes in data. Quick reactions require near-instant access to data, risk analysis and deeper computational analysis for effective decision making. View this webcast to learn how to achieve real-time awareness by managing ever-increasing data volumes and transaction rates.
This video webcast is designed to help those with little to no virtualization experience understand why virtualization and VMware are so important to driving down both capital and operational costs. The session will start with the introduction of the key concepts and technologies of virtualization, introduce the vSphere Hypervisor, and build up to an overview of VMware vSphere® 5, the world's most robust and complete virtualization platform. This session will also discuss new solutions such as the vSphere Storage Appliance and VMware GO that are making it easier than ever before to get started with virtualization.
Newsletter Sign-Up »

Receive the latest news test, reviews and trends on your favorite technology topics

Choose a newsletter
  1. View all Newsletters | Privacy Policy
Resource Center