Agree. Before I retired I made do with the gnu textutils, lots of little Perl scripts or one-liners, and SQL via MS Access or SQLite.
Almost never managed to set up a data pipeline: it was normally a case of scrabbling to find the (any) data, spending ages cleaning it up, understanding it, normalising it enough to be analysed, [x], and making the data graphics. The [x] indicates the comparative amount of work that went into writing the queries and spitting out the results.
If you like such have a look at the book "Your code as a crime scene" as well... All used tools are free, but you might need to adjust them some if you're working on Windows (why are all the good ones working on Linux?!) Huge fun visualizing your codebase, based on your git/svn repository. Who "owns" which corners of code, who produces more bugs,... git blame extended!
To analyze software architecture also have a look at Sotograph. Though this thing is really expensive...
And thanks for your link... Let's see if I'll get to work today ^^
I have used Azure Data Studio for some notebooks when I was experimenting with SQL notebooks and PySpark one. Other than that, I do not feel like it is broad enough to be used as a Notebook editor.
On the other hand, I am using VS Code for my primary data science-related tasks. The Python extension and other supportive extensions make it easy and fast to work with Notebooks.
I have sometimes been recommended to use the in-browser experience, but that doesn't work for me. Like, why browse all the way to a directory when 99% of my apps support drag-and-drop.
Lastly, I wanted to try out the Google Colab, and here is one thing that I do not like at all! They do not support the "collab" part of Google Colab. I started working with my friend on a notebook task, and it never showed the changes in real-time. We needed to hit F5 a lot just to get the current code. Which kills the purpose of collaboration, right? The on-demand CPU/GPU part is amazing nonetheless.
I might be a noob with Google Colab or I might have left some button turned off, but if you were able to figure out how this collaborative part works (if it works) in Google Colab, please let me know.
The sh*t I complain about
It's like there ain't a cloud in the sky and it's raining out - Eminem
~! Firewall !~
Yes, Notepad++ is awesome. I've used it many times. It is small and lightweight but has many highly useful features. Back in the day (DOS days that is), VEdit and VEdit Plus (written by Greenview Data, Inc.) was a very similar program. They supposedly still have a Windows version (see www.vedit.com). I haven't used the Windows version since they first came out with it, and it wasn't as good as the DOS version at the time. I'm sure it is improved greatly, and now days is probably nearly identical to Notepad++. Notepad++ is free whereas Vedit is not.
Yup, Qlik is the way to go.
I personally use it very infrequently, but it is a top-notch BI tool.
I do use Excel more regularly, but not in a specific data-analysis capacity.
Also, Qlik does not require your data to be thrown into an Excel spreadsheet, it can hook up to almost any database commercially available.
* Disclaimer: The company I work for is a Qlik partner, meaning we sell licenses and implement customer solutions in Qlik. Not my department, but still.
Oh man... now I have to look up what they are, just in case.
If something has a solution... Why do we have to worry about?. If it has no solution... For what reason do we have to worry about?
Help me to understand what I'm saying, and I'll explain it better to you
Rating helpful answers is nice, but saying thanks can be even nicer.