Software Development and Programming Careers (Official Discussion Thread)

Regular Developer

Supporter
Joined
Jun 2, 2012
Messages
8,250
Reputation
1,866
Daps
23,249
Reppin
NJ
I’m helping lead a transition to the cloud, and the leap is insane, more so because of petty stuff like not being given full IAM permission rights.

This is our first time using airflow and there’s a bit of a learning curve. We’ve finally got a handle of much of what we need to do to get started but damn.

There was like no help or guidance for all the frustrating ish we encountered.
We kind of have a hybrid of our own stuff. We're using Control-m generally, but then we're making use of a cyclic lambda jjob that checks our database tables and SNS to check s3 file landing spots.

Documentation is definietly important, so we can hand things off to someone else
 

null

...
Joined
Nov 12, 2014
Messages
29,284
Reputation
4,909
Daps
46,470
Reppin
UK, DE, GY, DMV
We kind of have a hybrid of our own stuff. We're using Control-m generally, but then we're making use of a cyclic lambda jjob that checks our database tables and SNS to check s3 file landing spots.

Documentation is definietly important, so we can hand things off to someone else

I started learning AWS cloud this spring. I am at uni again and we are doing a project using AWS. I took the first cert and planned to do the dev cert now but have been too busy.

I'll do that in spring.

Once you move an organization onto cloud services, especially the managed services, it must be a nightmare to get it off.

Control-M within AWS?

IMO Control-M is better for big installations. At small german bank IB side we used to use autosys.
 

Regular Developer

Supporter
Joined
Jun 2, 2012
Messages
8,250
Reputation
1,866
Daps
23,249
Reppin
NJ
I started learning AWS cloud this spring. I am at uni again and we are doing a project using AWS. I took the first cert and planned to do the dev cert now but have been too busy.

I'll do that in spring.

Once you move an organization onto cloud services, especially the managed services, it must be a nightmare to get it off.

Control-M within AWS?

IMO Control-M is better for big installations. At small german bank IB side we used to use autosys.
Yea, control-m, the ui is a lot easier to control the flow. If we need to hold a job, we can just right click and do it. But currently, with our glue workflows, only the admin team has read/write access in prod, so we have to use our built in method to hold, stop, start, resume, or skip things in our workflow.

But its a lot cheaper (or so I'm told, looking at cost is above my pay grade, lol) running our jobs in AWS than via Cloudera and Hive. I'm sure the admin team is happy not having to manage and upgrade clusters with us using serverless glue.

One of the cool things also is we used to take 7-8 hours to do file ingestion through hadoop. with some random days, it taking up to 13 hours. And we'd get pinged by the business because they need to do their sales reports in the mornings. These jobs would start at midnight and just keep running. But now, all those jobs take less than an hour. So those departments haven't had to ask us about data not being available since we've made the move.

Yea, once you get in cloud, if your not using things like containers or terraform, it definitely makes it a pain to get migrate.
 

Ethnic Vagina Finder

The Great Paper Chaser
Joined
May 4, 2012
Messages
54,873
Reputation
2,682
Daps
155,468
Reppin
North Jersey but I miss Cali :sadcam:
It's crazy. I starting learning to code last august. I flipped flopped from web to software development. I finally setting on software and apps. I'm in the midst of trying to build a tech start up using nothing but AI. I picked an existing space with the idea of making it better, be it esthetics and/or performance. I've learned how to do product research, map out features, put together an overview, create a file structure and create mockups using excel, all before any code is written.

And from my experience, I will say this about AI. It's cool if you're creating basic web pages or basic software tools. But if you're building complete builds, it's going to make the same mistakes humans make. I've had to make corrections or call out the AI for giving me the wrong shyt multiple times. In the beginning, I would just ask it to write a whole file. When it didn't work, I would show it the errors and tell it to write it again. Then I started doing my own investigations and asking the AI questions. Basically, you have to use it as a collaboration tool and not something you can expect to produce everything. I initially went from using Claude, ChatGTP, Cursor, and Bolt, to just ChatGTP and Claude. And the only reason why I use 2 is because 1. chat limitations, and 2. They both give different perspectives.
 

Rev Leon Lonnie Love

damned mine eyes, DAMNED mine eyes!!
Joined
Nov 11, 2017
Messages
22,045
Reputation
5,639
Daps
89,522
Keep me in the loop here brehs.

Is FAANG still the end goal and the ultimate job worth having in the tech space.

I get the pay, equity, benefits and prestige but is it really something that’s sought out after, considering how quickly we saw them gut entire departments and forced rto.


That just doesn’t interest me the way a stable and “ethical” company does
Shieet, it sure is to me. It opens up doors. Tired of struggling to find a new job. Having FAANG on that resume will have teams ready to interview you just cause of the experience you might bring.
 

Regular Developer

Supporter
Joined
Jun 2, 2012
Messages
8,250
Reputation
1,866
Daps
23,249
Reppin
NJ
It's crazy. I starting learning to code last august. I flipped flopped from web to software development. I finally setting on software and apps. I'm in the midst of trying to build a tech start up using nothing but AI. I picked an existing space with the idea of making it better, be it esthetics and/or performance. I've learned how to do product research, map out features, put together an overview, create a file structure and create mockups using excel, all before any code is written.

And from my experience, I will say this about AI. It's cool if you're creating basic web pages or basic software tools. But if you're building complete builds, it's going to make the same mistakes humans make. I've had to make corrections or call out the AI for giving me the wrong shyt multiple times. In the beginning, I would just ask it to write a whole file. When it didn't work, I would show it the errors and tell it to write it again. Then I started doing my own investigations and asking the AI questions. Basically, you have to use it as a collaboration tool and not something you can expect to produce everything. I initially went from using Claude, ChatGTP, Cursor, and Bolt, to just ChatGTP and Claude. And the only reason why I use 2 is because 1. chat limitations, and 2. They both give different perspectives.
Yup, I think we've all ran into those same limitations. It especially struggles with languages or tools with less of an online community and will make things up instead of saying I don't know
 

Obreh Winfrey

Truly Brehthtaking
Supporter
Joined
Nov 18, 2016
Messages
20,852
Reputation
25,262
Daps
131,948
@Obreh Winfrey Do you know of any good resources to prepare for the Docker Certified Associate certification?
Sorry, I don't have any leads for you. This Reddit post says hands on experience is what you need to pass


I've been so far removed from Docker lately that I didn't know they got bought out until just now.
 

BlaxOps

Pro
Joined
Jul 18, 2015
Messages
1,006
Reputation
151
Daps
1,460
Reppin
MiYaYo (Carol City)
Sorry, I don't have any leads for you. This Reddit post says hands on experience is what you need to pass


I've been so far removed from Docker lately that I didn't know they got bought out until just now.

Appreciate the link.

I will be getting into container security on the vulnerability management side, so I need to get familiar with the tools. I like to know when an admin is making excuses. :mjtf:
 
Last edited:

bnew

Veteran
Joined
Nov 1, 2015
Messages
56,458
Reputation
8,326
Daps
158,360

1/1
@DeepLearningAI
😞



GcW2ls0W0AAGM0K.jpg



To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

Pete Wrigley

Twerk, Petunia, Twerk!
Supporter
Joined
May 1, 2012
Messages
5,619
Reputation
4,746
Daps
25,459
Anyone mess with Rust? I'm a web developer and haven't programmed in any low level languages....ever. I would love to mess with Rust doe :jbhmm:
 

Ethnic Vagina Finder

The Great Paper Chaser
Joined
May 4, 2012
Messages
54,873
Reputation
2,682
Daps
155,468
Reppin
North Jersey but I miss Cali :sadcam:
I finally gave up on Tauri. :snoop:

First I tried Rust + Tauri + Svelte but build my software poject.
Then I tried Rust + Tauri + Leptos because Sveltekit kept conflicting with Tauri.


I moved everything over to Go + Wails + Svelte. So for the build is less complicated and Wails is 10x less complicated than Tauri.

I've been trying to build this shyt for the past 3 weeks. I've made the same amount of progress with this stack in 1 day :dahell:

Hopefully it will be finished by tomorrow so I can start testing.
 

cyndaquil

Lv 100 Bold natured
Joined
Sep 2, 2014
Messages
7,098
Reputation
1,041
Daps
24,085
Reppin
JOHTO REGION
I finally gave up on Tauri. :snoop:

First I tried Rust + Tauri + Svelte but build my software poject.
Then I tried Rust + Tauri + Leptos because Sveltekit kept conflicting with Tauri.


I moved everything over to Go + Wails + Svelte. So for the build is less complicated and Wails is 10x less complicated than Tauri.

I've been trying to build this shyt for the past 3 weeks. I've made the same amount of progress with this stack in 1 day :dahell:

Hopefully it will be finished by tomorrow so I can start testing.
Now you see some of the tradeoffs in implementing the same solution with different tech stacks. If they ask you that in a system design interview you can give a reasonable answer.
 

Ethnic Vagina Finder

The Great Paper Chaser
Joined
May 4, 2012
Messages
54,873
Reputation
2,682
Daps
155,468
Reppin
North Jersey but I miss Cali :sadcam:
Now you see some of the tradeoffs in implementing the same solution with different tech stacks. If they ask you that in a system design interview you can give a reasonable answer.

I started with Python, because that's the only language I studied/learned over the past year that deals with software development.

I ended up building 5 different iterations, before learning Python is slow as fukk when it comes to building enterprise grade software.

I thought about using C++ even downloading Visual Studio and playing around with it, until I realized the UI was shyt and Qt was shyt. It would've taken me longer to build the UI than the actual code.


Another thing I learned. Even though I'm using mostly Claude and ChatGTP to build this, it's not nearly enough. Both make mistakes, and you still have to be comfortable using IDE's and understanding the file tree for the different stacks you're using. You have to know enough, to catch errors the AI makes. With Tauri and Rust I spend hours on researching the documentation alone. Tauri 2.0 is still relatively new so there's not much documentation and the community is small.

The app I'm building, would usually take a team of developers to build, or a 20 year seasoned developer. But I respect everyone who knows how to do this shyt :wow:

I spend a year learning HTML/CSS/JavaScript basics with no practical application. I've learned more about coding or how everything works, but using AI to build, and then try to correct where it fukked up.

And I'm not really a fan of Svelte. The only reason why I picked it over React or Vue etc. is because of how light weight it is.
 
Top