Articles, Blog

CERN Computing Centre (and mouse farm) – Computerphile

October 5, 2019


Okay, then. We’re in and this is the computing center at cern [I] mean really this is the brain of the large Hadron collider Now it’s really loud [in] here. It’s not a place where I can easily do interviews or give you a live commentary so I’m recording this afterwards, but I just wanted you [to] see what it looks like and hear what it sounds like When you walk [through] these kind of little corridors here I can’t tell [you] how hot it is the hot air is just blasting you from both sides it’s like being in a little oven and Of course, it’s so loud. I mean you can hardly hear yourself think Now this is really the heart of what cern calls the grid which is a network of computer systems and centers around the world That’s used to process the insane amount of data produced by the Large Hadron Collider the LhC Produces about 600 million particle collisions our second and although they don’t keep everything. I mean that would be crazy They just keep a tiny 100,000 snapshots per second that’s still a fair [amount] of viously and that means they’re storing about where they’re storing over a Thousand megabytes per second and it makes its [way] here to the data center now the data doesn’t just need storing it needs Processing and that’s where the grid comes in This center is the start of it all and they call it tier zero. It’s the tier zero center Then there are tier one, you get tier twos, and you get tier threes, and they’re scattered all over the world Together they allow thousands of physicists to access all this information and more Importantly crunch all the data process [it] make sense of it all and I mean just the tier 0 Center here alone does a million jobs a day and it can transfer up to 10 gigabytes of data Every second and I mean these are just numbers obviously, but when you think about it They’re pretty high numbers Now as you can [see] here some of these banks some of these racks of computers are kept in kind of these glass enclosures I Didn’t actually ask about that, but I’m assuming it’s all sealed so that it’s more easy to to keep air-conditioned and to keep cool Calling this place is just so important and in fact here you see these big blue towers [I] mean, that’s part of the air conditioning system. [I’m] pretty sure they told me if the cooling fails everything gets switched off very quickly Otherwise they have bit of a meltdown I do love that you sort of have these little keyboards and computers on the end of the rex [too] I mean, I mean it’s obvious that your wood, but it’s somehow amuses me I’m not sure why I mean I sometimes think the cables behind my computer and television are complicated when I see this place I feel like my head’s going to explode Now we’ve come upstairs the [Center’s] actually spread over two floors and here We see the cartridges or tapes that a lot of the information stored on One of the storage units here for the tapes was actually being worked on while I was there so the door was open and I Could have a look inside Now often when the information on these tapes is accessed. There’s kind of this robotic, sort of a device type thing that scurries around the racks and Pulls out the tapes [and] whenever I wasn’t filming it would go whizzing around doing all this cool stuff But as soon as I started filming it all kind of stopped and I had to wait for ages But I was determined to show you one in action and eventually eventually I’ve managed to get this You get the idea okay now. We’ve come up to a little sort of room where you can see over the center This is the [ground-floor] part of the center again You can see how high the ceiling is that’s actually not a good thing modern data centers actually have low ceilings I think it’s because it’s easier to cool the rooms if the rooms are smaller But this was built at a time when well computers were a lot bigger it’s actually in a lot of ways the building in the rooms quite outdated for the purpose, but They’re still using it [I] think it’s certain they prefer spending their money on a new kit rather than new buildings and They’re still doing a pretty good job and here’s one last thing. I want to show you it’s actually outside the computer center They call this the soon animal shelter for computer mice It’s bit of a joke But it’s where the it’s where the computer mice go to retire when they’re then no longer in use Is mice the plural [where] [the] mouse’s must be mice? Anyway there it is. It’s a bit of fun now [as] I said it was remarkably loud in the center, so it wasn’t really easy to do interviews But I did do interviews [with] people that work here at the computer Centre You’re going to be [able] to see them [very] soon here [on] computer file Sean who I work with is going to be having all that going through all adding it together soon So stay tuned for that also while we were at cern We made a music video for the sixty symbols channel if you haven’t seen that yet Go and have a look it was a bit of fun And I also recorded something about the corridor where the world wide web was developed and that video is already on computer file So you can go and check that out, too? There’s so much to look at thanks for watching this and we hope to see you soon for more videos

100 Comments

  • Reply Melthornal September 14, 2013 at 2:32 pm

    It is strictly nonstandard, ie incorrect English, to say "computer mice". It doesn't matter if you care or not, you aren't the one who gets to decide.

  • Reply Josh B September 14, 2013 at 8:34 pm

    watch/GyWHkwX7_gg

  • Reply Melthornal September 15, 2013 at 2:54 pm

    You are very much wrong. Mouse is *not* an acronym. The acronym was invented afterwards as a gimmick. Second, OED only lists 'mice' as "acceptable" because it was the first listed plural of computer mouse. The issue you're running into is that everyone who has any understanding of how English works has recognized that "computer mice" is grammatically incorrect and have changed to "computer mouses." If you were to spend the time to actually read the OED entry, maybe you would understand this.

  • Reply Gai Ikari September 15, 2013 at 10:28 pm

    cool, so you finally agree that the OED says Mice is acceptable. So between that and common usage my point is made. Mice is correct and acceptable. Society lead and the OED followed, you stragglers who are so OCD about a back set of rules and compliance will get there in time or just die out and the argument will be forgot and won by default.

    Interesting discussions, bye.

  • Reply Melthornal September 16, 2013 at 3:00 am

    It doesn't list it as actually acceptable, it lists it as an abandoned error in history. There is a difference. OED lists philome, for fucks sake. When was the last time you ever saw philome spelled that way? Never? Oh, maybe you read Shakespeare once? Because I'm pretty sure Shakespeare was the only person to ever spell it that way. Everyone else spells "film."

  • Reply TechLaboratories September 16, 2013 at 2:11 pm

    That's what I saw too – All of the servers faced inward to the sealed cold aisle, which they drew their intake air from. While it decreases the amount of reserve cold air in a power failure, it also makes the data center bearable to work in (without a coat…) as opposed to the hot aisle which uses the outside space of the data center for cold air resevoir and pairs all of the servers back-to-back, creating rows of hot.

  • Reply NULUSIOS September 16, 2013 at 5:27 pm

    Νο.

  • Reply Guillermo Mendez-Kestler September 16, 2013 at 5:40 pm

    I agree it does look like a hot cold aisle setup.

    Without knowing the full setup or viewing the interviews, I'm assuming that CERN has some kind of data tiering going on. Maybe the same kind referenced in the video. Otherwise those tapes would be really slow to process roughly a Gig/sec.

  • Reply afhdfh September 17, 2013 at 3:46 pm

    In 30 years, all these computers will fit into your watch…

  • Reply Serieus Frank September 18, 2013 at 6:21 pm

    LOFAR >CERN

  • Reply Mr.Gobelsack September 18, 2013 at 7:57 pm

    No cause there is actually a limit.

  • Reply afhdfh September 18, 2013 at 9:39 pm

    For now… 😉

  • Reply Mr.Gobelsack September 18, 2013 at 11:54 pm

    No I mean that there is an actual physical limit.

  • Reply afhdfh September 19, 2013 at 6:49 am

    I now. 🙂 However, I'm sure that this is only true for conventional methods. We'll probably figure something out eventually. Like quantum computing (though this won't be commercially usable unfortunately)…

  • Reply Stuntddude September 19, 2013 at 12:38 pm

    No, in 30 years this will be your typical workstation. Moore's law doesn't act nearly that fast.

  • Reply Dustin Strickland September 21, 2013 at 3:44 pm

    Unless quantum computing advances, we're basically stuck right where we're at…. The transistors that we use today can't get any smaller. I also vaguely recall hearing something about using lasers to make a material temporarily conductive, and how that sort of technology could be used to make processors with performance measured in petaflops

  • Reply andy September 23, 2013 at 8:09 am

    That will be one hell of a huge watch.

  • Reply andy September 23, 2013 at 8:09 am

    That will be one hell of a huge watch.

  • Reply andy September 23, 2013 at 8:09 am

    That will be one hell of a huge watch

  • Reply discflickerDotcom September 24, 2013 at 7:21 pm

    next time, please show what it looks like undeneath the raised flooring… underneath those white tiles; wires, cables, lines, etc.look like a nightmare, so every line is supposed to be labeled to track what gets plugged into what.

    the air-conditioning is all blown into this under-the-floor space and flows up into all of the machines seated on the raised-flooor from there.

    i've spent many an hour crawling underneath the raised floor of live computer centers
    untangling unlabeled messes!

  • Reply lesorax123 September 25, 2013 at 8:08 am

    Im visiting this place next saturday.

  • Reply tfsupp "Technical Facilities Support" September 26, 2013 at 10:05 am

    It is using Hot & Cold isle system with cold isle containment & is the glassed in area. hot isles can get very hot 40c+.
    This is common type of cooling for server farm. There are many types of hot cold isle some with under floor deliver & higher ceilings (Still built like this depending on requirements like fresh air cooling etc) or can be low ceilings & no under floor delivery. There are dozens of combinations & depend on size, location, weather, computing purpose or your particular philosophy.

  • Reply tfsupp "Technical Facilities Support" September 26, 2013 at 10:06 am

    It is using Hot & Cold isle system with cold isle containment & is the glassed in area. hot isles can get very hot 40c+.
    This is common type of cooling for server farm. There are many types of hot cold isle some with under floor deliver & higher ceilings (Still built like this depending on requirements like fresh air cooling etc) or can be low ceilings & no under floor delivery. There are dozens of combinations & depend on size, location, weather, computing purpose or your particular philosophy

  • Reply walter0bz September 26, 2013 at 2:03 pm

    but can it run cr….

  • Reply walter0bz September 26, 2013 at 2:03 pm

    but can it run cr..

  • Reply walter0bz September 26, 2013 at 2:04 pm

    can it run crysis

  • Reply Jerry Lifsey September 27, 2013 at 12:41 pm

    Antarctica should be a server farm.

  • Reply Jerry Lifsey September 27, 2013 at 12:49 pm

    IF Moore's Law continues at computing power doubling every two years (or the same computing power halves in size), this room will be 1/1024th the size in 30 years with the same computing power.

  • Reply Stuntddude September 27, 2013 at 9:41 pm

    Yeah, and if you haven't noticed, the room is HUGE. Moore's law works to exclusively either halve the size, double the power, or halve the cost every two years (given, for each, that the other two factors stay constant). Consider, also, that the cost of this whole installation must be insane. And finally, 2^15 is 32768, not 1024. 1024 is 2^10.

  • Reply dzjad October 1, 2013 at 6:35 pm

    So the front of the computers are enclosed to provide probably cold air–and the backs are exposed as the outflow of hot air. So colder air is provided only to the exact spot it needs to be (the entrance to the system needing cooling).

  • Reply Draxis32 October 4, 2013 at 12:14 am

    Probably not…you ignored some laws while making this prediction.

  • Reply gtamateur October 4, 2013 at 4:01 am

    Not really… no in our current form of transistor. The law of Moore is near his end except is cubit pc come and save the day

  • Reply afhdfh October 4, 2013 at 8:17 am

    🙂 Can't they manipulate single atoms now? I'm pretty sure that people are smart enough to find a way around Moore's law… 😉

  • Reply Bob October 5, 2013 at 1:12 pm

    GLaDOS?

  • Reply gtamateur October 5, 2013 at 9:29 pm

    Yeah, but you can't go under a certain limits of atom because Electron can pass trought the transistor's gate even technically in classical physic they couldn't

  • Reply afhdfh October 5, 2013 at 10:03 pm

    Sh*t!
    Maybe someday, there might be some way to trick physics… maybe… 😉

  • Reply D. Tysen October 6, 2013 at 1:26 am

    Well the strict Moore's law says that transistors will get exponentially cheaper, which means they have to get smaller to fit into a consumer device. A transistor needs to be about 50-100 atoms across so that current can't just bypass the semiconductor, and researchers are already building prototypes about that size. Even if that weren't true, if the trend continues for 10 years we'd be making parts out of individual atoms, and you can't get smaller than that.

  • Reply D. Tysen October 6, 2013 at 1:28 am

    A generalised version of Moore's law would just say that computing power over cost increases exponentially, and that might be true but it would require having a totally different kind of computing from what we have now.

  • Reply AnarchyEngineer October 6, 2013 at 6:50 pm

    When I went there about 3 years ago as part of a school physics trip, saying that the server room is a warehouse is an understatement. Heck, it has a transformer outside the size of a small house to power this. Very impressive stuff!

  • Reply gtamateur October 6, 2013 at 8:33 pm

    The smallest gate you can possibly do is a 12 phospho. atom one

  • Reply gtamateur October 6, 2013 at 8:33 pm

    that why we are starting to work on Quantic Pc 😀

  • Reply Yandy October 10, 2013 at 5:01 am

    Tapes are still the cheapest and most reliable backup storage. Infinitely cheaper and still functional for what they need it for.

  • Reply yesyes yesno October 10, 2013 at 11:26 am

    and this is where quantum physics enters the ring 🙂 it will put an end to Moore's law

  • Reply Thrust vectoring October 11, 2013 at 2:08 pm

    Not only LHC, CERN is not just LHC, there are lots of experiments – like ISOLDE, nTOF, SHINE, COMPASS, CLIC, CAST, ACE, AEGIS, ALPHA, ASACUSA, ATRAP, CLOUD, AMS, AWAKE, DIRAC, MODEAL, OSQAR, TOTEM, UA9 and NA62.

  • Reply GumokCZ October 11, 2013 at 5:34 pm

    This video for Computerphile is like the Bullion Vault video for Periodic Videos.

  • Reply gtamateur October 11, 2013 at 8:24 pm

    yeah you are right, quantic pc don't use transistors :D. i re-read myself and i was wrong, cubit won't save law's moore.

  • Reply Brenton Kludt October 14, 2013 at 12:24 am

    Like how computers one day can't get any smaller??

  • Reply Mutrify Gaming October 15, 2013 at 7:29 pm

    Yes. There is a limit.

    To put it simply computers are made of a lot of transistors connected with "wires".(And of course insulators that stop electricity from going the "wrong" way, and a bunch of other stuff). You need at least X atoms to make a transistor, or a "wire", where X > 1(a lot bigger). You can't make a conducting wire or transistor that's "half" an atom across.

    If that makes sense.(Just trying to explain, the picture is a lot more complex in the real world.)

  • Reply Dawid Stasiak October 15, 2013 at 8:28 pm

    If there is, physics has probably got it already figured out, there is a technological limitation more than theoretical 😉

  • Reply Dawid Stasiak October 16, 2013 at 11:12 pm

    That's either some next level physics or you're trolling me, i tried to research that on the internet but do not understand it 🙁 but then again I'm in my second year of college doing physics where we still learn about newton's laws of gravitation -.- and i know quite a lot about modern physics, hence why I want to do theoretical physics at uni ^^

  • Reply LimitedWard October 17, 2013 at 10:23 pm

    That is until they perfect quantum computers.

  • Reply Jakub Blažej October 18, 2013 at 9:20 pm

    what capacity are they?

  • Reply randfur October 19, 2013 at 12:18 am

    This was VERY cool to see, thanks four giving us a decent and down to Earth tour of the place.

  • Reply 666qwertz October 21, 2013 at 7:37 am

    Not really, quantum computers can only do certain (mathematical computation) jobs a lot faster. It wouldnt be much useful for most tasks you do in your daily life using a computer.

  • Reply LimitedWard October 21, 2013 at 10:03 am

    That's only because scientist have not discovered the other uses of quantum computing. Keep in mind, this technology is still in it's infancy. When computers were first invented, we only thought they would be useful for simple arithmetic or tabulation problems for large companies. We never knew the direction computers would take just as we will not know where quantum computing will take us.

  • Reply xXmrflipXx October 21, 2013 at 3:04 pm

    How much fps will minecraft get on this?

  • Reply 99codemister October 21, 2013 at 7:21 pm

    about 30 fps. Java sucks.

  • Reply xXmrflipXx October 22, 2013 at 6:52 pm

    😀

  • Reply Morbitron October 24, 2013 at 11:44 pm

    That would not do a thing because you new to reinvent the way you process information and I don't think of passing from a binary system (base 2) to a base 16. To now, the only theoric ways of using qBits told us that it is way better a doing parallel calculation instead of sequential.

  • Reply SacredFireFly October 25, 2013 at 8:40 pm

    *Java is awesome, Notch sucks.

  • Reply jota theatre October 29, 2013 at 12:01 am

    A wifi connection in your watch and a cloud service should be enough :d

  • Reply AlbinoBunny October 29, 2013 at 1:38 am

    A limit for classical computing.

  • Reply ANON YMOUSE October 29, 2013 at 2:01 pm

    How about quantum computers?

  • Reply Mackie October 31, 2013 at 1:05 am

    Moore's law m8

  • Reply 99codemister November 5, 2013 at 2:06 am

    The language is awesome, the JRE is not. Also, since Notch left the project there was plenty of optimization done. Also, it's challenging to optimize graphics in Java since you can't take advantage of a gpu.

  • Reply Joshua Brockschmidt November 13, 2013 at 6:26 am

    I had no clue what I was looking at when I started the video, but I sensed I was somehow getting a glimpse of heaven.

  • Reply Ben Duncan January 24, 2014 at 5:00 am

    I'm from USAmerica, and it's 'mouses.'

  • Reply MrSaemichlaus February 23, 2014 at 12:32 pm

    Looks like a Minecraft Adventure Map – like "The Great LHC Escape" 😀

  • Reply acadianalien February 26, 2014 at 1:12 am

    Everytime I see amazing feat like this, I just want to show it to all those conspiracy theorists who think that we can`t build the Egyptian pyramids with modern technology.

  • Reply Bo Duholm March 30, 2014 at 9:17 pm

    I think the blue ducts are blowing Cold air into the enclosures you see through the floor. The servers then suck in the Cold air from the front and blow it out the back. That way you don't have to cool the entire hall, but only the small corridors between the servers and extract the heat from the ceiling of the hall.

  • Reply Marco April 12, 2014 at 3:50 pm

    i was there too! 🙂
    it is very impressive!

  • Reply riskinhos April 30, 2014 at 5:44 pm

    I hope they use renewable energy for all that cooling.

  • Reply riskinhos July 20, 2014 at 2:42 pm

    CERN's total annual electricity consumption is 1TWh -1,000,000 MWh or 1,000,000,000 kWh:
    40 to 45% is for the LHC (including 12 to 14% for cryogenics and 7 to 9% for cooling and ventilation)
    10 to 12% is for the LHC experiments (ATLAS, CMS, ALICE and LHCb)
    28 to 32% is for the SPS (including 6 to 7% for the North Area experiments)
    2 to 3% is for the PS + Booster + Linac
    5 to 6% is for the Computer Centre (B513)
    7 to 9% is for offices and restaurants, etc.

    CERN is supplied by RTE
    Réseau de Transport d'Électricité (Electricity Transmission Network) is responsible for the operation, maintenance and development of the French high-voltage transmission system.
    RTE is a wholly owned subsidiary of the partially public-owned French generator Électricité de France (EdF)

    EdF:
    nuclear: 84.7%;
    renewable energy: 8.3% (among which 4.6% from hydroelectric plants);
    gas: 2.7%;
    charcoal: 2.7%;
    fuel: 1.2%;
    other: 0.4%.

    so, CERN power comes from nuclear. far from clean. good luck managing the radioactive waste. shame on them. with all that money they could have gone renewable.

  • Reply Jim Raynor July 20, 2014 at 5:54 pm

    Brady you are amazing. If you want someone to work for you, message me.

  • Reply Mesrop iskandaryan July 22, 2014 at 8:40 pm

    this is fiber glass

  • Reply Alex McMahon July 27, 2014 at 7:08 am

    The consoles at the end are hilarious because it's almost like a simple desktop to more computer than you can imagine. So little to control so much.

  • Reply Jakub Dudarewicz July 30, 2014 at 10:30 am

    Please, give us the interviews, they were mentioned at the end of the video, but there was no link :C

  • Reply Clitern Tools August 13, 2014 at 1:19 pm

    those server on Booter 😀 would crash everything:D:D

  • Reply Capt-Morgan August 23, 2014 at 7:40 am

    In laymen's terms, can someone please explain the point of crashing particles into one another? I understand what CERN has been able to produce in the modern era, but how do you make the jump from particle acceleration, to something like creating the Internet, or other?

  • Reply Capt-Morgan August 23, 2014 at 7:42 am

    3:48 is cool, but nothing epic. Some businesses operate those machines. I would like to learn about their backup method though – imagine the off-site backup of the initial backup? Or maybe they use incremental backup? heh

  • Reply cgdermot October 6, 2014 at 5:06 pm

    Why use tapes? would SSD's not be better? I guess they might be reliable but waiting for the selector arm, then the load time. I don't get it.

  • Reply gixeff 750 March 15, 2015 at 10:55 pm

    wtf is happening here?

  • Reply Andrea Degasperi June 14, 2015 at 12:07 pm

    Why don't they use a water cooling system? i.e. Google use it!

  • Reply Jivan Scarano August 10, 2015 at 10:19 am

    The plural is mouses, but I guess mice is fine here, given the pun they were going for.

  • Reply DerpMans Derpyskin September 26, 2015 at 10:48 pm

    IBM Drives!? You should be using T10000 drives!! Ridiculous.

  • Reply JG October 25, 2015 at 11:49 pm

    Thanks for waiting to get that robot shot. Was worth it, very futuristic looking!

  • Reply Peter Walker October 29, 2015 at 11:54 am

    They look like Dell servers.

  • Reply BigBen Hebdomadarius November 11, 2015 at 1:33 am

    Don't be daft, Brady–of course it's "mice," not "mouses."

  • Reply vvviiimmm November 19, 2015 at 10:29 pm

    what are those tapes? hard drives?

  • Reply Ryan Mitchell December 5, 2015 at 10:51 am

    "They're just numbers, but when you think about it, they're pretty high numbers"
    To make the obvious comment, I can't help but be reminded of the room filling mainframes of the 50's and 60's.
    Except these are more modular, and fill up entire warehouses instead.
    I was gonna say, even 10GB/s seems kinda low for today's standards, especially considering how many machines where working on it, but then I noticed this video was from 2013.
    I just wanna show someone in the future 1:52–2:06 and watch them piss their pants.

  • Reply Agent Smidt January 16, 2016 at 3:57 am

    But can it run Crysis?

  • Reply mipmipmipmipmip January 20, 2016 at 9:31 pm

    And we're in like Flynn!

  • Reply Newest Updates April 17, 2016 at 2:48 pm

    Is it Gigabyte/second or Gigabit/second?

  • Reply Sander Deryckere May 3, 2016 at 11:58 am

    The sealing is also good to keep dust out. You can blow filtered air into the sealed corridor, and it will blow dust and heat out through the computers towards the unsealed corridors. (and the building itself also happens as a second sealing)

  • Reply David Refoua September 25, 2016 at 10:03 pm

    Thanks for sharing! Your commentary was great btw

  • Reply TechUploadFR February 25, 2017 at 10:23 pm

    i also have been in that computing center, it's really amazing!

  • Reply Zipp4Everyone January 22, 2018 at 1:52 am

    Yeah server rooms aren't generally known for their relaxing atmosphere…

  • Reply DNB April 21, 2018 at 6:12 am

    That tape storage machine was like Star Wars.

  • Reply steve b October 22, 2018 at 6:44 pm

    Who saw sir Tim berner Lee?

  • Reply Andrei January 22, 2019 at 3:57 pm

    and in 2019 10GB/s doesn't sound that impressive, you can get 10 Gbit network at your home, not that you'll really need one

  • Leave a Reply