CERN's Search for God (Particles) Drives Massive Storage Needs

Think your storage headaches are big? Try being the guy in charge of storing the 1GB of data per second every day for a month coming off CERN's large hadron collider (LHC).

PAGE 2

The solution he chose was a 4Gbps Fibre Channel SAN, using a clustered file system. Why a clustered file system? "We didn’t want storage strictly linked with a hardware vendor," he says.

For the clustering, the team is using Quantum's StorNext software as its file system. "Performance was our number-one concern," he says. The second concern was flexibility. "This large buffer means a lot of hardware," he says. "StorNext makes our SAN much more flexible. You can work with different hardware technologies, and it's completely vendor independent." Finally, CERN had to ensure scalability. "It's often the case that physics experiments are upgraded and the system must be able to evolve," he says.

File systems such as StorNext, which let users share files across multiple platforms (i.e., they don’t care if a Windows server or a Solaris server needs to access a particular file), are growing in popularity, after being more common in the research and university environments, says Noemi Greyzdorf, a research manager who follows storage software for IDC (a sister company of CIO.com’s publisher, CXO Media). Clustered file systems are still an evolving category, she says, but enterprise IT is warming up to it.

"There's been a push toward clustered file systems in the enterprise," she says. "With the growth of unstructured data, there's an increasing need for a centralized way to manage it."

Other options in this category include IBM's General Parallel File System and Symantec's Veritas Storage Foundation Cluster File System. StorNext is known in the category for its performance, data sharing across operating systems and moving data across tiers, Greyzdorf says.

The data acquisition team for ALICE particularly valued StorNext's affinity feature, Vande Vyvre says, because it lets the team avoid data being written to the same disks at the same time, which would cause performance issues. "This is what we used to keep the data traffic separated in streams, to avoid any slowdowns," he notes.

As for Vande Vyvre's tips to CIOs considering clustered file systems, he says don’t underestimate the value of the hardware vendor flexibility for drives and arrays. "We are quite happy to have stuck to our wish for a system that is vendor independent. The experiment will have a lifetime of 10 years. We know in principle we can keep the file system during that time," he says.

CERN

Loading...
Data Center MarketSpace
From Chaos to Order-Winning the Information Management Game
Learn how Oracle Application Express delivers an easy, fast, and free way to manage your business information. Learn more »
Optimizing Information Insight
This paper will argue that the key to enabling midsize organizations to make even better business decisions is by simplifying the extraction of specific, actionable information from large volumes of data. Learn more »
Looking for a fast payback?
Learn how you can boost ROI and productivity with a JDE technology refresh. Learn more »
3 Minutes with Free Tool Can Save Thousands!
See how you can improve decision-making while reducing your total cost of ownership through process efficiencies and technology simplification. Learn more »
Informatica 9: What it means for the CIO?
Hear from Informatica's CIO on how Informatica 9 will improve... Learn more »
Lower Costs with New Servers and Consolidation
When it comes to server technology staying the course will cost you. Lower costs and create an efficient datacenter with newer server technology. Learn more »
 
SPONSORED LINKS
 

White Paper: Right-Sizing Your Power Infrastructure

Lower IT Costs with Oracle Database 11g Release 2

New technology that addresses challenges organizations are facing.

Return on Information: Google Enterprise Search pays you back

Cut Costs & Green Your IT Operations with PC Power Management

White Paper: 4 Customer Service Myths

White Paper: Managed Security for a Not-So-Secure World

White Paper: 5 Best Practices for Smartphone Support

Global Research: CIOs Weigh In On Virtualization

5 Key Virtualization Management Challenges

Secure Email and Web-Based Communication from Evolving Attacks

WagerWorks Takes Fraudsters Out of the Game using iovation

Seven Design Requirements for Web 2.0 Threat Protection

Increase UPS efficiency without sacrificing protection.

Learn how advanced forecasting tools can deliver significant business results for global corporations.

Achieving Business Agility with Application Grid

Ready to virtualize tier one applications? Check your virtualization maturity.

Seven Ways ITIL Can Help You in an Economic Downturn

Tips for successful virtualization management.

AT&T Synaptic Storage as a Service. Expand on demand

Trend Micro ranked #1 against real-world malware. Read more.

Webinar: Jump-start your in-house e-discovery with Ringtail QuickCull from FTI Technology

Streamline IT Costs. Boost Performance with WAN Optimization.

Build your 1st app FREE with Force.com

TDWI checklist helps define data readiness for analytics. Download report.

State of the Data Integration Market

Server Consolidation: Leveraging the Benefits of Virtualization

Upgrading to VMware vSphere with vWire

Maximizing website Return on Information with high-quality search

See how AT&T can help protect your network.

Webcast: Unleashing the Power of Customer Data

White Paper: Improve Agility with Operational Responsiveness

White Paper: Legacy Tools: Not Built for the Helpdesk

Taking a Seat at the Executive Table: The Reality of Virtualization

White Paper: Next Generation Remote Infrastructure Management

Keeping Your Members Safe from Online Scams and Predators

The Total Economic Impact of Network Security Intrusion Prevention

Generation Remote Infrastructure Management - Changing the Paradigm

Cloud-Based Email Management: Opinion Shifts In Favor

eBook: How Can You Make Your People Productive Anywhere?

White Paper: Visibility and the New Normal of Mobile Work

Taking the Service Desk to the Next Level

Learn about The Information Technology Infrastructure Library.

Return on Information: Google Enterprise Search pays you back. Get the facts.

VMware. The source for Business Infrastructure Virtualization.

ShoreTel tells businesses to untangle from competitors' complexity and turn to its brilliantly simple UC solution

Top Five CIO Challenges

Read the RSA report: Security for Business Innovation

64-page prescriptive guide to security, compliance, and IT operations.

A Clear View Toward Virtualization

 
 
RESOURCE CENTER