CERN's Search for God (Particles) Drives Massive Storage Needs

Think your storage headaches are big? Try being the guy in charge of storing the 1GB of data per second every day for a month coming off CERN's large hadron collider (LHC).

PAGE 2

The solution he chose was a 4Gbps Fibre Channel SAN, using a clustered file system. Why a clustered file system? "We didn’t want storage strictly linked with a hardware vendor," he says.

For the clustering, the team is using Quantum's StorNext software as its file system. "Performance was our number-one concern," he says. The second concern was flexibility. "This large buffer means a lot of hardware," he says. "StorNext makes our SAN much more flexible. You can work with different hardware technologies, and it's completely vendor independent." Finally, CERN had to ensure scalability. "It's often the case that physics experiments are upgraded and the system must be able to evolve," he says.

File systems such as StorNext, which let users share files across multiple platforms (i.e., they don’t care if a Windows server or a Solaris server needs to access a particular file), are growing in popularity, after being more common in the research and university environments, says Noemi Greyzdorf, a research manager who follows storage software for IDC (a sister company of CIO.com’s publisher, CXO Media). Clustered file systems are still an evolving category, she says, but enterprise IT is warming up to it.

"There's been a push toward clustered file systems in the enterprise," she says. "With the growth of unstructured data, there's an increasing need for a centralized way to manage it."

Other options in this category include IBM's General Parallel File System and Symantec's Veritas Storage Foundation Cluster File System. StorNext is known in the category for its performance, data sharing across operating systems and moving data across tiers, Greyzdorf says.

The data acquisition team for ALICE particularly valued StorNext's affinity feature, Vande Vyvre says, because it lets the team avoid data being written to the same disks at the same time, which would cause performance issues. "This is what we used to keep the data traffic separated in streams, to avoid any slowdowns," he notes.

As for Vande Vyvre's tips to CIOs considering clustered file systems, he says don’t underestimate the value of the hardware vendor flexibility for drives and arrays. "We are quite happy to have stuck to our wish for a system that is vendor independent. The experiment will have a lifetime of 10 years. We know in principle we can keep the file system during that time," he says.

CERN

Loading...
Data Center MarketSpace
IT Consolidation Made Easy
The Primary IT Initiative for Reducing Costs Learn more »
Data Center Cost Analysis
Read this white paper to see how a server refresh can actually save money and meet green initiatives. Learn more »
The Future Data Center
Building the next-generation data center requires a forward-thinking strategy that encompasses a broad range of new technologies. Learn more »
Cutting the Cost of Enterprise Databases
This IDC white paper discusses the growing complexity of datacenter management, which is causing escalating costs. Learn more »
8 Tactics to Combat Vulnerabilities
This white paper reviews 8 key elements of vulnerability management and provides advice on combating known vs. unknown vulnerabilities. Learn more »
Lower IT Costs with Oracle Database 11g Release 2
Learn how upgrading to Oracle Database 11g Release 2 can transform your business, budgets, and service levels Learn more »
An Alternative Database Approach
Learn how a column-oriented DBMS works, why it has superior performance, reduced data access latency and a reduced storage footprint. Learn more »
 
SPONSORED LINKS
 

White Paper: Right-Sizing Your Power Infrastructure

Lower IT Costs with Oracle Database 11g Release 2

New technology that addresses challenges organizations are facing.

White Paper: 4 Customer Service Myths

White Paper: Managed Security for a Not-So-Secure World

White Paper: 5 Best Practices for Smartphone Support

Global Research: CIOs Weigh In On Virtualization

5 Key Virtualization Management Challenges

Secure Email and Web-Based Communication from Evolving Attacks

WagerWorks Takes Fraudsters Out of the Game using iovation

Seven Design Requirements for Web 2.0 Threat Protection

Generation Remote Infrastructure Management - Changing the Paradigm

Cloud-Based Email Management: Opinion Shifts In Favor

eBook: How Can You Make Your People Productive Anywhere?

White Paper: Visibility and the New Normal of Mobile Work

Taking the Service Desk to the Next Level

Learn about The Information Technology Infrastructure Library.

Top Five CIO Challenges

Streamline IT Costs. Boost Performance with WAN Optimization.

Want to know how you can maximize employee productivity?

Build your 1st app FREE with Force.com

TDWI checklist helps define data readiness for analytics. Download report.

A new fleet of PCs with a total ROI in 10 months. Find your ROI.

eZine: A Roadmap to Reducing IT Complexity

Reduce risk, gain agility. See how Progress can help your business.

State of the Data Integration Market

Server Consolidation: Leveraging the Benefits of Virtualization

See how AT&T can help protect your network.

Webcast: Unleashing the Power of Customer Data

White Paper: Improve Agility with Operational Responsiveness

White Paper: Legacy Tools: Not Built for the Helpdesk

Taking a Seat at the Executive Table: The Reality of Virtualization

White Paper: Next Generation Remote Infrastructure Management

Keeping Your Members Safe from Online Scams and Predators

The Total Economic Impact of Network Security Intrusion Prevention

Join us at the US-Brazil IT-BPO Summit, on November 10th in New York.

Increase UPS efficiency without sacrificing protection.

Learn how advanced forecasting tools can deliver significant business results for global corporations.

Achieving Business Agility with Application Grid

Ready to virtualize tier one applications? Check your virtualization maturity.

Seven Ways ITIL Can Help You in an Economic Downturn

Tips for successful virtualization management.

Unified Communications: Thoughts, Strategies and Predictions. Join the discussion

Read the RSA report: Security for Business Innovation

Webcast: Looking to the Cloud for Email and Collaboration Services

64-page prescriptive guide to security, compliance, and IT operations.

Keep your IT expertise up to date. Join the Intel Premier IT Professionals.

A Clear View Toward Virtualization

Virtualization Technology as a Business Solution

The rules of infrastructure management just changed.

 
 
RESOURCE CENTER