Click here to Skip to main content
15,895,746 members

Welcome to the Lounge

   

For discussing anything related to a software developer's life but is not for programming questions. Got a programming question?

The Lounge is rated Safe For Work. If you're about to post something inappropriate for a shared office environment, then don't post it. No ads, no abuse, and no programming questions. Trolling, (political, climate, religious or whatever) will result in your account being removed.

 
GeneralRe: Code Pin
Sander Rossel5-Oct-20 21:46
professionalSander Rossel5-Oct-20 21:46 
AnswerRe: Code Pin
ZurdoDev6-Oct-20 1:16
professionalZurdoDev6-Oct-20 1:16 
GeneralRe: Code Pin
Maximilien6-Oct-20 1:31
Maximilien6-Oct-20 1:31 
GeneralRe: Code Pin
W Balboos, GHB6-Oct-20 1:30
W Balboos, GHB6-Oct-20 1:30 
GeneralRe: Code Pin
obermd6-Oct-20 3:41
obermd6-Oct-20 3:41 
GeneralRe: Code Pin
Gerry Schmitz6-Oct-20 3:48
mveGerry Schmitz6-Oct-20 3:48 
GeneralRe: Code Pin
rnbergren6-Oct-20 5:56
rnbergren6-Oct-20 5:56 
NewsUK Track and Trace system Pin
F-ES Sitecore5-Oct-20 12:07
professionalF-ES Sitecore5-Oct-20 12:07 
(Note: disclaimer is at the end)

There was a blip in reported covid cases in the UK as the system used to report the data to the government systems didn't work for a day so the results were rolled into the next batch of reported data. The cause of the blip was that the people collecting the results sent the data to the government systems using XLS files and due to the increasing number of cases the data exceeded the capacity for XLS files so they had to rejig the system to batch the data instead of putting it all in one file.

As software engineers we can all agree there are issues here but as we're not privy to the inners of the system we can only guess at why certain decisions were made. If I was sending raw data to a third party system with (presumably) no API then I'd choose CSV files. However if the data was intended for human consumption then Excel is probably a decent solution. Rather than just raw numbers in cells it can have descriptive meta info at the top such as the source of the data, date it was taken on and so on, then the data itself in rows below. Another reason they might use XLS files is that it's easier to handle quotes, commas and other funny data, letting the proprietary format handle those issues, and while there are existing CSV frameworks that support that data off the shelf you have to bear in mind the time pressures to get this system working and the potential red tape etc in using a project written by some random that they found on github in a government system.

Regardless of the reasons XLS files were used there were obvious failings in that no-one thought to test the capacity of the system so too many assumptions and no thinking about the long-game. So yeah there are flaws here obviously.

What is annoying me though is the way this has been reported and reacted to on places like twitter, where you normally find nothing but well-informed, intellectually honest, non-partisan debate. 99.99% of posts I have seen about this have been of the same ilk, obviously written by people who don't understand the tech. The prevailing narrative being pushed is that the data is stored in Excel files rather than a database. However if that was the case then the data that was missed on the fateful day would probably be lost forever. The fact that it was produced later on in multiple files rather than one demonstrates that the data is indeed stored elsewhere and simply packed in XLS files for distribution to interested parties. No developer, no matter how poor, would really suggest to store data in Excel.

The next most common argument you see is that they are using an "old" version of Excel due to the storage limits encountered. Again as developers I'm sure we can all agree that if we needed to generate an XLS file from data, using Excel to do this would be the last solution we'd use. It is far more likely another method was used such as Odbc drivers or one of the third-party solutions more suited to automation.

Other arguments are over the cost, as if using XLS files to send data has some kind of major effect on costs, the implication being that the whole system is just an Excel spreadsheet that someone maintains, ignoring the costs of everything else that will be involved, not just the cost of software and licenses but the salaries of the people who built in.

It's just maddening seeing so much speculation and ill-informed opinions posted as facts, it must be awful if you actually worked on that system, seeing so many people post so much wrong information and just having to sit there and do nothing, as one of the issues with twitter is that there is no single person or thread to respond to, it is just a wall of people all posting the same thing with nothing you can do to counter it.



Disclaimer: I hope this thread is ok to post in the lounge, I'm NOT looking to discuss tracing in general, if it is effective, how effective any government has been in handling this, good or bad, this is simply about a rather public failing in software system.
GeneralRe: UK Track and Trace system Pin
Greg Utas5-Oct-20 12:44
professionalGreg Utas5-Oct-20 12:44 
GeneralRe: UK Track and Trace system Pin
Marc Clifton5-Oct-20 15:19
mvaMarc Clifton5-Oct-20 15:19 
GeneralRe: UK Track and Trace system Pin
OriginalGriff5-Oct-20 19:39
mveOriginalGriff5-Oct-20 19:39 
GeneralRe: UK Track and Trace system Pin
Wastedtalent5-Oct-20 20:57
professionalWastedtalent5-Oct-20 20:57 
GeneralRe: UK Track and Trace system Pin
OriginalGriff5-Oct-20 21:28
mveOriginalGriff5-Oct-20 21:28 
GeneralRe: UK Track and Trace system Pin
Richard MacCutchan5-Oct-20 21:41
mveRichard MacCutchan5-Oct-20 21:41 
GeneralThey gave up here in Oz Pin
enhzflep6-Oct-20 20:27
enhzflep6-Oct-20 20:27 
GeneralRe: UK Track and Trace system Pin
trønderen5-Oct-20 20:23
trønderen5-Oct-20 20:23 
GeneralRe: UK Track and Trace system Pin
DerekT-P5-Oct-20 22:12
professionalDerekT-P5-Oct-20 22:12 
GeneralRe: UK Track and Trace system Pin
trønderen5-Oct-20 22:44
trønderen5-Oct-20 22:44 
GeneralRe: UK Track and Trace system Pin
DerekT-P5-Oct-20 23:26
professionalDerekT-P5-Oct-20 23:26 
GeneralRe: UK Track and Trace system Pin
trønderen6-Oct-20 4:38
trønderen6-Oct-20 4:38 
GeneralRe: UK Track and Trace system Pin
5teveH5-Oct-20 20:30
5teveH5-Oct-20 20:30 
GeneralRe: UK Track and Trace system Pin
OriginalGriff5-Oct-20 21:29
mveOriginalGriff5-Oct-20 21:29 
GeneralRe: UK Track and Trace system Pin
5teveH5-Oct-20 21:37
5teveH5-Oct-20 21:37 
GeneralRe: UK Track and Trace system Pin
Jörgen Andersson5-Oct-20 23:43
professionalJörgen Andersson5-Oct-20 23:43 
GeneralRe: UK Track and Trace system Pin
OriginalGriff6-Oct-20 0:10
mveOriginalGriff6-Oct-20 0:10 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.