{"id":22,"date":"2024-06-06T13:16:10","date_gmt":"2024-06-06T11:16:10","guid":{"rendered":"https:\/\/stefanescu.lu\/?p=22"},"modified":"2024-06-18T18:42:30","modified_gmt":"2024-06-18T16:42:30","slug":"how-google-really-runs-production-systems","status":"publish","type":"post","link":"https:\/\/stefanescu.lu\/?p=22","title":{"rendered":"How Google <really> runs production systems"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n

#articles #cloud

If there is a book that engineers working in operations have (started to)read in the past 8 years, chances are that the book’s title is Site Reliability Engineering with the subtitle: HOW GOOGLE RUNS PRODUCTION SYSTEMS… except that it doesn’t, as we will see below.

\u00ab\u00a0During the initial deployment of a Google Cloud VMware Engine (GCVE) Private Cloud for the customer using an internal tool, there was an inadvertent misconfiguration of the GCVE service by Google operators due to leaving a parameter blank. This had the unintended and then unknown consequence of defaulting the customer\u2019s GCVE Private Cloud to a fixed term, with automatic deletion at the end of that period.\u00a0\u00bb

The customer in this case was UniSuper, an Australian pension fund that manages $135 billion worth of funds and has 647,000 members.

UniSuper had the nasty surprise on 2nd of May, 2024 to see its multi-geography cloud infrastructure… disappear. It took them almost 2 weeks (until 15th of May) to be fully back online – and that mostly thanks to offline backups (see this article]<\/a> from arstechnica)

Read the official account from google here<\/a>.<\/p>\n\n\n\n

<\/pre>\n","protected":false},"excerpt":{"rendered":"
#articles #cloud If there is a book that engineers working in operations have (started to)read in the past 8 years, chances are that the book’s title is Site Reliability Engineering with the subtitle: HOW GOOGLE RUNS PRODUCTION SYSTEMS… except that … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[17,20],"tags":[],"class_list":["post-22","post","type-post","status-publish","format-standard","hentry","category-devops","category-engineering"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t