Rawtid

Veteran
Supporter
Joined
Jun 23, 2012
Messages
43,323
Reputation
14,658
Daps
119,432
Please let us know if the class or the software is worth getting into.

The software is like others I have used before. It's just different names for some of the tools, but many of the same functions. I have seen a few job postings utilizing the cert/ software (just general search), and they seem to have a good network.
 

Mindfield333

Superstar
Joined
Jun 16, 2012
Messages
16,547
Reputation
1,829
Daps
47,656
Reppin
NC
I’m in the middle of the coursera joint right now. Anybody changed their profession to a data science discipline recently?
 

Macallik86

Superstar
Supporter
Joined
Dec 4, 2016
Messages
6,673
Reputation
1,503
Daps
21,866
Do yall typically clean data through SQL or Power BI? I'm trying to decide on a process for a personal project. The data is going to end up in Power BI and it is easier to automate in Power BI but I feel like I should be using SQL for some reason.... I don't have any scripts written so PBI's automation is easier to understand for now. Perhaps I can extract the data to SQL Server as a backup?
 

Secure Da Bag

Veteran
Joined
Dec 20, 2017
Messages
41,325
Reputation
21,368
Daps
129,525
Do yall typically clean data through SQL or Power BI? I'm trying to decide on a process for a personal project. The data is going to end up in Power BI and it is easier to automate in Power BI but I feel like I should be using SQL for some reason.... I don't have any scripts written so PBI's automation is easier to understand for now. Perhaps I can extract the data to SQL Server as a backup?

I normally clean data with SQL/SSIS. I've never done it in Power BI. This will be my project doing so. As my boss says, "in theory this should be easy". :manny:
 

Rawtid

Veteran
Supporter
Joined
Jun 23, 2012
Messages
43,323
Reputation
14,658
Daps
119,432
Do yall typically clean data through SQL or Power BI? I'm trying to decide on a process for a personal project. The data is going to end up in Power BI and it is easier to automate in Power BI but I feel like I should be using SQL for some reason.... I don't have any scripts written so PBI's automation is easier to understand for now. Perhaps I can extract the data to SQL Server as a backup?

If a company is using SQL server as a data source, the data should already be cleaned, most likely via SSIS BEFORE it’s loaded in the database. Since it’s just a personal project, use query editor.
 

Macallik86

Superstar
Supporter
Joined
Dec 4, 2016
Messages
6,673
Reputation
1,503
Daps
21,866
If a company is using SQL server as a data source, the data should already be cleaned, most likely via SSIS BEFORE it’s loaded in the database. Since it’s just a personal project, use query editor.
My company has a Reporting team responsible for loading the data, so I just query data and don't know a lick of SSIS lol.

With this data, it is just some stuff online on my personal computer but it is refreshed daily during the week. I have a manual workflow workaround that I've been working on automating for the last few hours:
  1. Manually copy/paste the data from Google Sheets to Excel
  2. Run a Macro to clean up/standardize it.
    1. The macro also outputs a datestamped csv file... From there, I think there has to be some capabilities for SQL to locally scan a folder and import new files?
When replying to this thread though, I googled Power BI for the heck of it to see what their solution in when it comes to working with Google Sheets. Since Google Sheets is a website instead of a program, Power BI can scrape the data. Completely overlooked that functionality so Excel and the macros were overkill lol.

That feeling when you just spent 5 hours on a task and then find an online solution that takes less than 45 minutes:mjlol:
 

Macallik86

Superstar
Supporter
Joined
Dec 4, 2016
Messages
6,673
Reputation
1,503
Daps
21,866
Jumping back in Power BI after a hiatus. My job requires me to make Cubes in Visual Studio and then import that to Power BI. Still wrapping my head around the entire process.
 

TheAnalyst504

Rookie
Joined
Nov 18, 2016
Messages
190
Reputation
50
Daps
369
Coli Brehs,

Do any of you have experience with data analysis using Tableau or PowerBI?

I'm looking for a set of assignments to help display competency using of those platforms.
 
Top