{"id":4610,"date":"2023-03-02T13:25:02","date_gmt":"2023-03-02T04:25:02","guid":{"rendered":"https:\/\/bdrtimes.riken.jp\/?p=4610"},"modified":"2023-04-07T14:08:15","modified_gmt":"2023-04-07T05:08:15","slug":"yohno","status":"publish","type":"post","link":"https:\/\/bdrtimes.riken.jp\/en\/2023\/03\/02\/yohno\/","title":{"rendered":"Taking on the world with a unique computer"},"content":{"rendered":"<p>This time we have Dr. Yousuke Ohno, who works on the design of MDGRAPE, a computer specialized for running molecular dynamics simulations. If you really think about it, the development of MDGRAPE has been going on since before 1990, which was around the time when Windows 3.1 was finally released. Looking back now, isn\u2019t it amazing to think how its development began in an era with such inefficient computers? With that in mind, let\u2019s hear more from Dr. Ohno, including about that history.<\/p>\n<aside>\n<h3 class=\"interviewee\">Yousuke Ohno<\/h3>\n<p>Senior Technical Scientist in the Laboratory for Computational Molecular Design. He holds a Ph.D. in astronomy from the University of Tokyo. He was involved in the design and production of GRAPE starting from his undergrad days, and after working on the development of specialized computers for uses such as observational astronomy, he began working on MDGRAPE. Since he began working in Osaka, he has been a fan of watching movies with surround sound.<br \/>\n<\/aside>\n<h2>A computer specialized for simulating molecules<\/h2>\n<p class=\"yakushiji\">The \u201cMD\u201d in MDGRAPE stands for \u201cmolecular dynamics.\u201d That means it\u2019s a computer that simulates molecules, right?<\/p>\n<p>To put it simply, it\u2019s a computer specialized for running simulations that model atoms as spheres and the forces that work between atoms as springs. It examines the shapes that molecules take, and the interactions between them. For instance, there was a simulation of the interactions between novel coronavirus (SARS-CoV-2) proteins and the drugs that bind with them. Watching it may help you understand:<br \/>\n<iframe loading=\"lazy\" title=\"\u65b0\u578b\u30b3\u30ed\u30ca\u30a6\u30a4\u30eb\u30b9\u30bf\u30f3\u30d1\u30af\u8cea\u306e\u67d4\u3089\u304b\u3044\u69cb\u9020\" width=\"900\" height=\"675\" src=\"https:\/\/www.youtube.com\/embed\/w0O0cyJ98WE?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" allowfullscreen><\/iframe><\/p>\n<p class=\"yakushiji\">They just keep going round and round.<\/p>\n<p>It\u2019s easiest to understand this when you actually run an MD simulation, but even though atoms stick to one another, the direction of their stickiness varies quite a bit. This video was made to show a framework that is easy to understand, but in the actual simulations, the atoms of every single individual amino acid are calculated.   <\/p>\n<p class=\"yakushiji\">What\u2019s the approximate time scale?<\/p>\n<p>One computational step is one femtosecond (fsec, 10<sup>-15<\/sup> seconds or one quadrillionth of a second!), and this video shows the activity over one microsecond (\u03bcsec, 10<sup>-6<\/sup> seconds or one millionth of a second). For a video of this length, there are one billion calculations performed. Even still, the simulation needs to run longer in order to sufficiently simulate the behavior of proteins.  <\/p>\n<h2>Origins in astronomical simulation<\/h2>\n<p class=\"yakushiji\">The \u201cGRAPE\u201d in MDGRAPE comes from \u201cgravity,\u201d right?  <\/p>\n<p>The story starts back in the 1990s, with Dr. Yoshihiro Chikada (honorary professor, National Astronomical Observatory of Japan) at the Nobeyama Radio Observatory in Nagano Prefecture. He came up with the idea that by creating a specialized computer it would be possible to run calculations related to the <em>n<\/em>-body problem.  <\/p>\n<p class=\"yakushiji\">Right now, all we can do for the <em>n<\/em>-body problem is run numerical simulations.<\/p>\n<p>Newton\u2019s law of universal gravitation states that gravity has an infinite range, so if you had, say, one billion stars, there\u2019s gravity working between each pair of them, meaning you have to calculate individually the gravitational force of one billion stars x one billion pairs of stars. The actual calculation programs adopt approximation algorithms to reduce the number of calculated combinations; therefore, even if the number of particles increases by a factor of 10 in commonly used algorithms, the computational complexity does not increase by a factor of 100, rather it is maintained within a factor of approximately 30. There was a proposal that specialized hardware would significantly speed up the calculations for galaxies and groups of stars called globular clusters. Dr. Daiichiro Sugimoto (who was then a professor at the University of Tokyo College of Arts and Sciences) took this proposal, thinking it would be useful in researching the evolution of globular clusters, and set to work on its development. The hardware was named GRAPE, since it subdivides the gravity equation, lines up the many operation circuits, and calculates them in a sort of assembly line called the pipeline method.  At first it was only used to calculate gravitational force, but development went on to allow it to be customized for molecular dynamics simulations, which also calculate the forces that act between a pair of particles. <\/p>\n<p class=\"yakushiji\">I see. So, on a fundamental level, the gravity problem can also be modeled with a sphere and spring.<\/p>\n<p>MDGRAPE and GRAPE may calculate different phenomena, but both computers are specialized in solving the same problem.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-23-228x300.jpg\" alt=\"\" width=\"228\" height=\"300\" class=\"alignleft size-medium wp-image-4668\" srcset=\"https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-23-228x300.jpg 228w, https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-23.jpg 585w\" sizes=\"auto, (max-width: 228px) 100vw, 228px\" \/><\/p>\n<h2>Specialized computers and general-purpose computers<\/h2>\n<p class=\"yakushiji\">What\u2019s the difference between a computer, being specialized or being general purpose?<\/p>\n<p>Put simply, a specialized computer is specialized for running only certain calculations, with the ability to do other things pruned away. You could say it\u2019s a \u201cthoroughbred.\u201d<br \/>\nTake the calculation of gravitational force, for example. We have the equation for Newton\u2019s law of universal gravitation. You know the one:<br \/>\n\\begin{equation}F = G \\frac{m_1 m_2}{r^2} \\end{equation}<br \/>\nA computer does each of these calculations one by one.<\/p>\n<p class=\"yakushiji\">It multiplies the masses \\(m_1\\) and \\(m_2\\), then squares the distance <em>r<\/em>\u2026kind of like that?<\/p>\n<p>Yes, like that. In the problem we discussed earlier with one billion stars in a galaxy, it would do that calculation one billion x one billion times. Actually, the distance <em>r<\/em> is calculated from the coordinates <em>xyz<\/em> that show the positions of \\(m_1\\) and \\(m_2\\), so those calculations come in as well.<\/p>\n<p class=\"yakushiji\">A general-purpose computer can do those things too, can\u2019t it?<\/p>\n<p>A specialized computer has a circuit just for this calculation physically built onto its chip, and can\u2019t do any other calculations. This allows it to minimize memory use, increasing the speed of calculations.<\/p>\n<p class=\"yakushiji\">That sounds pretty niche! <\/p>\n<p>The COVID-19 protein simulation I showed previously has about one million atoms, and that is not the type of problem that could make use of the supercomputer Fugaku\u2019s capability. <\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-21-1024x558.jpg\" alt=\"\" width=\"900\" height=\"490\" class=\"aligncenter size-large wp-image-4671\" srcset=\"https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-21-1024x558.jpg 1024w, https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-21-300x164.jpg 300w, https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-21-768x419.jpg 768w, https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-21.jpg 1401w\" sizes=\"auto, (max-width: 900px) 100vw, 900px\" \/><\/p>\n<h2>The first petaFLOPs computer<\/h2>\n<p class=\"yakushiji\">Both astronomy and molecules deal with so-called \u201castronomical numbers.\u201d<\/p>\n<p>It\u2019s the combinations that are the problem.  If you increase the number of spheres, the number of combinations increases by the second power. <\/p>\n<p class=\"yakushiji\">That seems like it would require an awfully high-spec system. <\/p>\n<p>Yes, but it\u2019s okay for not every single part to be high-spec.<\/p>\n<p class=\"yakushiji\">What do you mean by that?<\/p>\n<p>As an example, if the number of particles increases by a factor of ten, the number of calculations for those combinations will increase by a factor of 100. But the computer\u2019s memory only has to retain information on the number of particles increased by ten. So, it is fine if the calculating ability of the computer is increased.<br \/>\nTaking that to the extreme, when MDGRAPE-3 was released, it was the first to achieve petaflop scale. FLOPS (floating point operations per second) are a standard for measuring computer performance, and a petaFLOP means that a computer is able to run one quadrillion (10<sup>15<\/sup>) calculations per second.  But as a specialized computer, it doesn\u2019t appear on the benchmarks for famous supercomputers, so it isn\u2019t included in TOP500 or other lists like that. Still, at that point, it was theoretically the highest performing computer in the world.<\/p>\n<p class=\"yakushiji\">I wish more people knew this fact.<\/p>\n<h2>Accelerating further<\/h2>\n<p class=\"yakushiji\">In order to run longer simulations, you need to accelerate the calculations even more.<\/p>\n<p>Yes, and when you do that, you run into problems with parts outside the nodes that perform the calculations.<br \/>\nOne is data transfer. The transfer of data from the nodes to memory becomes a bottleneck.<br \/>\nAs the number of calculations increases, the computer struggles to transfer the data. However, if you shrink the problem enough to let the transfer keep up, you end up just transferring data and doing no calculations. It ends up in a meaningless state for a computer to be in. <\/p>\n<p class=\"yakushiji\">I see. You can\u2019t just speed up the calculations and leave it at that.<\/p>\n<p>It\u2019s also not a matter of connecting a bunch of computers together. At this point, it turns into an argument about scaling.<\/p>\n<p class=\"yakushiji\">Scaling?<\/p>\n<p>Broadly speaking, there is an issue of strong versus weak scaling.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-20-1024x498.jpg\" alt=\"\" width=\"900\" height=\"438\" class=\"aligncenter size-large wp-image-4673\" \/><\/p>\n<p>For example, if 100 cooks use 100 frying pans, they can make 100 omelets in the same time it takes them to make one. This is called \u201cweak scaling.\u201d But this doesn\u2019t mean that they can make an omelet any faster. By contrast, strong scaling allows you to make one omelet in one-one hundredth of the time. It requires a different approach. <\/p>\n<p>Still, even with 100 frying pans, you can\u2019t make an omelet 100 times the standard size. After you\u2019ve made a frying pan that\u2019s 100 times bigger, the question of whether it works is the difference between supercomputers like Fugaku and simply connecting PCs together.<\/p>\n<p class=\"yakushiji\">What\u2019s coming up next?<\/p>\n<p>Right now, we\u2019re working on splitting calculations in a somewhat modular way, and designing the next computer as we improve the algorithms.<\/p>\n<p class=\"yakushiji\">I really learned a lot! I hope that MDGRAPE will become the world\u2019s fastest computer again!<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-22-1024x632.jpg\" alt=\"\" width=\"900\" height=\"555\" class=\"aligncenter size-large wp-image-4675\" srcset=\"https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-22-1024x632.jpg 1024w, https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-22-300x185.jpg 300w, https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-22-768x474.jpg 768w, https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2023\/02\/Untitled-22.jpg 1181w\" sizes=\"auto, (max-width: 900px) 100vw, 900px\" \/><\/p>\n<h3>Postscript<\/h3>\n<p>After hearing Dr. Ohno\u2019s riveting explanation, I thought it was a real shame that specialized computers like MDGRAPE are relatively obscure. Manufacture of the specialized chips used in these computers is also necessary, and he also told me the struggles of that process (namely their small production lots), but the conversation got so long that we couldn\u2019t fit it into this article. How sad\u2026<\/p>\n<section id=\"kikite\">\n<aside><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-3237\" src=\"https:\/\/bdrtimes.riken.jp\/wp-content\/uploads\/2021\/05\/profile.jpg\" alt=\"\" width=\"150\" height=\"150\" \/><\/p>\n<h3>Hideki Yakushiji<\/h3>\n<p>Business developer based in Kobe and a RIKEN alumni. He has a broad background in areas such as analytical chemistry, optics, biotechnology and IT. He is involved in a wide range of activities to assist in commercializing technologies and ideas born from academia, including setting up opportunities for idea-sharing, finding investors, and strategic planning.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This time we have Dr. Yousuke Ohno, who works on the design of MDGRAPE, a computer specialized for running molecular dynamics simulations. If you really think about it, the development of MDGRAPE has been going on since before 1990, which was around the time when Windows 3.1 was finally released. Looking back now, isn\u2019t it [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":4424,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_locale":"en_US","_original_post":"https:\/\/bdrtimes.riken.jp\/?p=4415","footnotes":""},"categories":[4],"tags":[68],"class_list":["post-4610","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-dive-into-research","tag-vol-12-2023-winter","en-US"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/posts\/4610","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/comments?post=4610"}],"version-history":[{"count":4,"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/posts\/4610\/revisions"}],"predecessor-version":[{"id":4686,"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/posts\/4610\/revisions\/4686"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/media\/4424"}],"wp:attachment":[{"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/media?parent=4610"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/categories?post=4610"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/bdrtimes.riken.jp\/wp-json\/wp\/v2\/tags?post=4610"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}