tag:blogger.com,1999:blog-7478606652950905956.post4921759120303002569..comments2024-03-18T22:50:29.792-07:00Comments on Cliff Mass Weather Blog: U.S. Climate Versus Weather Computers: Climate WinsCliff Mass Weather Bloghttp://www.blogger.com/profile/13948649423540350788noreply@blogger.comBlogger22125tag:blogger.com,1999:blog-7478606652950905956.post-42082007993257105132012-05-19T16:22:37.584-07:002012-05-19T16:22:37.584-07:00Still having trouble accessing the probcast site. ...Still having trouble accessing the probcast site. Hope it goes back up soon - it is by far my favorite source for a quick weather check! (especially when my day starts out with the classic Seattle question: is today a rain jacket day, or will I take my chances?)Amandahttps://www.blogger.com/profile/11777797286992277040noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-50171104966841254692012-05-18T19:47:54.105-07:002012-05-18T19:47:54.105-07:00Interesting post Cliff, most of which I agree with...Interesting post Cliff, most of which I agree with. If your numbers are right is worthy of pushing a little further. I feel I need to follow up on some of the comments:<br />To Chrisale:<br />I hear and understand your frustration. However, I suspect that no matter how much computer resource is thrown at climate research it won't change public policy in an appreciable way. The fundamental reason for inaction is uncertainty and how it is misunderstood (by the majority) or manipulated (by the minority on BOTH sides). Uncertainty will always exist in climate models just like in their close cousins, weather models. No amount of computer resource is going to change that - it is a policy problem. Most decision makers get it, they just don't want to do anything because the value proposition isn't obvious to them and/or because those that lose have huge amounts of influence.<br /><br />This leads me to agree with Cliff that priorities are wrong. Let me give you a poster child example...renewable energy. The RE industry is going through a huge contraction mainly because of unstable policy and because natural gas prices are obscenely low due to abundance of gas from fracking. But another important reason is that wind penetration has reached a level where the variability and uncertainty of the wind (and soon solar) matter and affect the overall economics and viability of the industry aside from making system operators very nervous about reliability. In some cases the cost is being allocated back to wind generators making it even more difficult to compete.<br /><br />But capital costs of developing renewables are have dropped a huge amount. If it were only possible to reduce uncertainty and predict variability, wind would look extremely attractive even against current natural gas prices. But the NWS budget has been hacked again this year, the profiler network is being retired with no replacement, our numerical models are way below par with the rest of the world etc etc. I even heard of the possibility of reducing the frequency of radiosondes which is frankly pathetic. So accurate forecasting is getting harder, not easier.<br /><br />Yet studies suggest (e.g. WFIP - Google it if interested) that with proper investment in volume observations and rapid refresh modeling, forecasts can be significantly improved. No hope of that because there is no money. So the irony is that the industry that really can do a lot to reduce our carbon footprint is running into a wall, in part because we won't invest in the cheapest way to make it work. Meanwhile an order of magnitude more resource is being channeled into proving a point which we already know to be true while not actually convincing any of those that matter.<br /><br />"As a respected…Cliff's every word will be seized upon to make a case for defunding climate research…” Sadly, I think this commenter is right. Great care is needed in forums like this, especially from influential people like Cliff, to make sure nothing can be bundled into a sound bite and used out of context.<br /><br />Priorities ARE wrong in my mind, and if there is a finite fund it SHOULD be spent on weather forecasting because weather forecasting can DIRECTLY help with mitigation. Of course we should continue climate research, and some of that will involve modeling, but since climate modeling is as much a part of the problem as part of the solution because it inherently illustrates uncertainty and because until the models are improved that uncertainty can't really be reduced, it seems ridiculous to prioritize such huge resources to climate modeling. The right place to improve models is in day to day weather prediction because it is (a) directly useful, (b) verifiable in the short term.<br /><br />If logic prevails resources are indeed perversely allocated. But, the reality is that if you take the money away from computational resources for climate research it is very unlikely that they will end up being used for weather forecasting, and in that reality I must confess I'd rather somebody got them than nobody.SharplyFocusedhttps://www.blogger.com/profile/08850999854488190488noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-63933900786637279702012-05-18T12:32:12.258-07:002012-05-18T12:32:12.258-07:00Great example here of how the present austerity fa...Great example here of how the present austerity fad reduces us to fighting like starving animals locked in a cage over a pool of dollars that is unnecessarily small. Add in a dash of irony by remembering the $4 billion+ in tax exemptions accorded US petroleum companies even as they enjoy record profits while changing our weather -and- climate.<br /><br />As a respected, reasonable and widely followed meteorological researcher Cliff's every word will be seized upon to make a case for defunding climate research, but don't look for 1:1 movement of dollars into weather modelling; it's -all- "big government" and needs to be killed, as far as the tax-dodgers currently controlling public finance are concerned.<br /><br />See these documents for facts on the ground w/regard to NOAA's budgets for weather and climate research:<br /><br />http://www.corporateservices.noaa.gov/nbo/fy13_budget_highlights/chapter4_NWS.pdf<br /><br />http://www.corporateservices.noaa.gov/nbo/fy13_budget_highlights/chapter3_OAR.pdfdbostromhttps://www.blogger.com/profile/13885863615343906724noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-67993556688894608462012-05-17T21:56:14.782-07:002012-05-17T21:56:14.782-07:00I agree strongly with devoting more data-crunching...I agree strongly with devoting more data-crunching resources to weather modeling, if only because understanding "weather change" will give us a more complete picture on what climate change (natural or human-caused) might look like. <br /><br />What is climatology? It's a way of measuring the prevailing weather conditions of a region in numerical (statistical) form. What is climate change? Basically a change in the climatological numbers. And what changes the numbers? Changes in the weather mechanics that a particular region experiences. <br /><br />Thus, to fully understand how CO2 and other gases change the climate, we need to understand how their infrared-absorption properties affect the thermodynamics and fluid dynamics of the atmosphere, and the kind of changes in weather regimes brought on by the extra heat absorption. You can't just say "Oh, same old weather patterns, just add 3 to 8 degrees to everything and we're good!" Different regions will see their weather patterns change in dramatic ways - ways that numbers on a climatology chart probably cannot reflect.Karl Bonnerhttps://www.blogger.com/profile/10418986386619849310noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-21206928198013232592012-05-17T20:27:08.697-07:002012-05-17T20:27:08.697-07:00Cliff,
Nice to see the rain drops in West Seattle...Cliff,<br /><br />Nice to see the rain drops in West Seattle on Thursday late afternnon. Somewhat unexpected, but welcome. They will certainly keep the just emerging bean plants damp. Yahooooo.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-18222152188354485542012-05-17T19:32:58.578-07:002012-05-17T19:32:58.578-07:00This comment has been removed by a blog administrator.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-82149645511056029102012-05-17T19:32:04.832-07:002012-05-17T19:32:04.832-07:00How does the NWS computing capacity compared to pr...How does the NWS computing capacity compared to private companies like Weather Underground that have proprietary models?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-84990349797675007512012-05-17T16:15:12.625-07:002012-05-17T16:15:12.625-07:00Rather than competing with the climate science com...Rather than competing with the climate science community, why not go after the computing power still being expended on nuclear weapons research?<br /><br />Paul MiddentsPaulhttps://www.blogger.com/profile/13742905742181959851noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-32130452734055970322012-05-17T12:49:26.968-07:002012-05-17T12:49:26.968-07:00'Sorry Cliff, but this is only way to ask you ...'Sorry Cliff, but this is only way to ask you this question. Could you recommend places to go on Sunday to maximize chances of seeing the solar eclipse? Olympia forecast is mostly cloudy, 40% chance rain. Thanks.Bobhttps://www.blogger.com/profile/09726805396038087981noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-21485865449840717282012-05-17T09:53:20.324-07:002012-05-17T09:53:20.324-07:00SKM,
We are surely on the same side...and I do...SKM,<br /> We are surely on the same side...and I do both climate and weather simulation. But the balance is clearly wrong...with weather prediction starved for resources and U.S. NWP dropping back to third or fourth place. Lives can be saved and the economic health of the U.S. can be aided by better numerical weather prediction...cliffCliff Mass Weather Bloghttps://www.blogger.com/profile/13948649423540350788noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-31045534666358400022012-05-17T08:54:02.263-07:002012-05-17T08:54:02.263-07:00I think we can do better for both realms without m...I think we can do better for both realms without making this an "us vs. them" type comparison (or for me "us vs. us" since I have my feet in both).<br /><br /> I think it is also unfair to assign all of NASA's, NOAA's, and NCAR's computing power to climate. That computing power is shared amongst many, many groups in both science and engineering. Climate modeling is not insignificant, but it is not the sole purpose of those supercomputers.<br /><br />I also agree with a previous commenter that things like investing in better observing systems or maintaining existing networks would help both realms immensely, since assimilation of data into both weather and climate models seems to improve the quality of the forecasts.<br /><br />There is some sharing amongst the weather and climate communities, but I think we need to expand on those collaborations, so that we can make advances in both communities while minimizing duplicate effort.SKMhttps://www.blogger.com/profile/12724692809446281313noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-86139569988115268452012-05-16T16:32:07.209-07:002012-05-16T16:32:07.209-07:00Cliff,
Do you have access to rewrite or request f...Cliff,<br /><br />Do you have access to rewrite or request features of the software used to derive the models?<br />If you do would it be possible to use scientific grade GPUs instead of general processing cores for all or part of the computations? Processing power per machine could be increased by 10-100x with much less equipment purchase than a cluster based on general CPUs alone. Existing equipment could be extended with these new features off computer which may or may not be an option.<br /><br />Technologies to look into:<br />1. Nvidia Tesla cards<br />2. Intel MIC (not out yet but nearly so)<br /><br />I work in image processing so cluster resources and performance are a big part of what we do.<br /><br />Best of luck in getting funding,<br />-ScottScotthttps://www.blogger.com/profile/13336163142203424476noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-30531373838107785892012-05-16T14:12:05.930-07:002012-05-16T14:12:05.930-07:00Cliff,
The point isn't how much computer powe...Cliff,<br /><br />The point isn't how much computer power climate studies (or any other particular project) has.<br /><br />It is how much would adequate facilities cost, versus how much we would save and what debacles we would avoid through more accurate forecasts.<br /><br />Perhaps the point is the small increment to the expenses we are already investing in weather infrastructure. Perhaps other costs in weather forecasting have lost value, and those resources should be shifted to big computers.<br /><br />The comparison of weather and climate computer costs is an unnecessarily indirect way to make your argument. Research and operational science are simply funded differently. Look at the price tag compared to the economic benefits of the big telescopes and the particle accelerators.John Vidalehttps://www.blogger.com/profile/09871768524749705799noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-9355677884509703892012-05-16T13:38:39.376-07:002012-05-16T13:38:39.376-07:00Great question! Even more so when you discover tha...Great question! Even more so when you discover that the climate models turn out to have a simple functional response to the forcings programmed into them. Willis Eschenbach made an interesting analysis of the GISS Model E last year. http://wattsupwiththat.com/2011/05/14/life-is-like-a-black-box-of-chocolates/<br /><br />I say give the climate modelers desk top PCs and let the weather modelers have the supercomputers!Unknownhttps://www.blogger.com/profile/00442111727077620331noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-61061972652081678772012-05-16T11:10:31.679-07:002012-05-16T11:10:31.679-07:00Well, I always predicted this moment would happen;...Well, I always predicted this moment would happen; when the debate against limiting CO2 emissions shifted from "climate change isn't real, so we shouldn't do anything about it" to "it's too late, so we shouldn't do anything about it."Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-10834101880405412192012-05-16T09:42:31.388-07:002012-05-16T09:42:31.388-07:00"We will do the experiment" Now watch a..."We will do the experiment" Now watch all the global warming nuts accuse Cliff of heresy. Hilarious.zorchhttps://www.blogger.com/profile/09631898398247548961noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-8844775381562545602012-05-16T08:48:53.218-07:002012-05-16T08:48:53.218-07:00My apologies Cliff if my post came off sounding mo...My apologies Cliff if my post came off sounding more accusatory than it should have. I admit I am easily frustrated these days by this topic.<br /><br />I agree that humanity has, by its inaction, doing part of the experiment.<br /><br />It just sounded in the original post like you were resigning yourself and humanity to that experiment rather than at least attempting to stop or limit it before catastropic loss of life and economy are inevitable.<br /><br />I think we're on the same page. I was just a little taken aback by the 'us or them' tone.<br /><br />I think perhaps this is a symptom of a larger problem the science community battles with... as a layman it seems to me like we spend a ton of money on research and development and other 'new' things, but we forget that the science of *now* is just as important, if not more so to the everyday person.<br /><br />I am thinking specifically of the loss over the past many decades of dozens of small-city weather sensors at Environment Canada. Downsizing of local forecasting. Even the elimination of lighthouse keepers on the West and East Coast of Canada in 'favour' of automated beacons and sensors. These have all contributed to a general decrease in the breadth and quality of data available.chrisalehttps://www.blogger.com/profile/04733469914802703736noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-76246648837498095902012-05-16T08:48:38.770-07:002012-05-16T08:48:38.770-07:00Cliff how dare you question in any way the Almight...Cliff how dare you question in any way the Almighty Anthropogenic Climate Change Gods.<br /><br />What they say or do is to be accepted without question, or else you are a "denier". Repent!bboynekohttps://www.blogger.com/profile/17309101165674510751noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-49222232442820998392012-05-16T08:00:00.051-07:002012-05-16T08:00:00.051-07:00Chrisale,
We can do both...but we need to reb...Chrisale,<br /> We can do both...but we need to rebalance where we are putting resources. We can save lives now. We can enhance economic productivity now. We know how to use more computer power to improve weather prediction today. And better forecasting enhances our ability to adapt to climate change. We are doing the climate change experiment, and quite frankly we don't need a single addition global climate run to know we have a problem. Mankind is simply not taking the actions needed to stop significant GW...this is not being defeatist, it is being a realist...cliffCliff Mass Weather Bloghttps://www.blogger.com/profile/13948649423540350788noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-78008339308736550252012-05-16T07:58:30.536-07:002012-05-16T07:58:30.536-07:00Thanks for the return of the probcast. I was miss...Thanks for the return of the probcast. I was missing it.Climate Critichttps://www.blogger.com/profile/03915211146164445171noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-46663593399316595912012-05-16T06:33:35.698-07:002012-05-16T06:33:35.698-07:00Honestly, I find the tone of this article disturbi...Honestly, I find the tone of this article disturbing.<br /><br />Yes, Climate Science has access to a huge amount of research resources. This is possibly because it is the most critical challenge to face humanity in its history.<br /><br />Perhaps if there wasn't so much idiotic "debate" about whether it's 'real' or not then there wouldn't be such a perceived need to predict what the climate will do in future. It *should* be enough that we know temperatures will rise as will sea levels, and acidity levels in the ocean... but it's not. Why? Well, I would rather not get into that.<br /><br />The defeatist "we are going to do the experiment." is equally disturbing especially from someone who claims to be concerned about saving lives.<br /><br />Yes, Weather prediction should have access to and would benefit immensely from some big upgrades in super-computers. But there is no need to make this an 'either/or'. <br /><br />Repurpose one of those multipetaflob supercomputers for weather prediction and we can have our cake and eat it too.chrisalehttps://www.blogger.com/profile/04733469914802703736noreply@blogger.comtag:blogger.com,1999:blog-7478606652950905956.post-52860345667153568762012-05-16T04:52:55.030-07:002012-05-16T04:52:55.030-07:00Hi, Cliff.
Our group at GFDL is indeed working on...Hi, Cliff.<br /><br />Our group at GFDL is indeed working on using our high-resolution HiRAM model, originally intended for climate simulation, for weather forecasting purposes. In particular we have been receiving funding from the Hurricane Forecast Improvement Project to use HiRAM as a next-generation hurricane model:<br /><br />http://journals.ametsoc.org/doi/abs/10.1175/WAF-D-10-05015.1<br /><br />We are currently doing experimental real-time ten-day global forecasts as well as seasonal predictions. It is a small fraction of Gaea's computing power, but we are doing research (hopefully!) useful for weather forecasting.Lucas Harrishttps://www.blogger.com/profile/14754544932981856512noreply@blogger.com