This isn't really what you were looking for so feel free to flag me as off topic since I'm kind of piggybacking on it. I feel like a lot of people at bigger companies know what needs to be done, how to do it, want to do it and sometimes have even purchased something to accomplish it but we have the hardest time getting traction.
I think one major issue is that manual processes often don't really "hurt" managers, they hurt the people doing them. To a developer or ops admin, "This $badthing caused by a typo won't happen again if we automate this" sounds very reasonable but sometimes managers just see it as a mistake that someone will need to be more careful about. Once they've factored the turnaround time into how they estimate they don't seem as interested in speeding things up. All that seems exacerbated by reactionary/feature driven mindsets which makes any kind of improvement that doesn't have an external event/person driving it very hard to get slotted. This seems to be made worse if you're working with a manager that's never really done the work that the people they're managing do or they did it so long ago they don't have an intuitive understanding of how it works today.
Another one is that a lot of people who perform a manual process for a long period of time become invested in it and defensive of it. No matter how much faster or better it is and no matter how involved they are if they end up feeling threatened it's probably dead in the water. Pretty typical human nature thing I think but at a big company with a lot of old established manual processes this can slow automation efforts down to a glacial crawl. Even if there's only one person that fully understands it I don't think managers appreciate the risk of having all of your eggs in one basket.
Eventually things do get automated but it seems like it's driven by a disaster or politics more than anything else. And sometimes not even disaster seems to be enough to drive real change if someone isn't pursuing it.
If anyone has tips on how to deal with any of this I'd love to hear them.
Automate your own tasks and do not tell anybody. Have a chilled out life!
It worked out for me until a got hospitalized for weeks and the college who took over my tasks figured it out. I did the same two more times and leard a lot about refactoring bad architectures. I jumped ship an sold myself as the guy who automates processes. Now I can refuse doing boring manual tasks. It makes me really satisfied.
This made me think of an old gig I had. It was a sort of so-easy-a-caveman-could-do-it tech support job. They actually had us printing out a report from an HTML document, cutting out portions that weren't supposed to be there with scissors, and then photocopying the cut up page to get a final report to mail out to the client. I'll let that sink in...
It didn't take me long to start editing the HTML document directly to skip the physical work (someone before me had figured this much out, but hadn't been able to teach anyone else well enough to pass it along when he left, just a vague rumor that it had happened). Then I went ahead and made a crude script to edit the documents automatically, ultimately turning an hour long job into a 2 minute one with cleaner looking results. Ended up spending a lot of time at that job just watching TV.
My next job after that was all about automating manual processes, but with less down time since I was automating other people's jobs, rather than my own. I think I preferred the former.
I used to work for a company basically copying and pasting data from one excel spreadsheet to the other. I didn't know how to program yet, but I knew there had to be a better way, so I learned macros. I spent ~20 minutes a day working. I worked part-time and when I left, my boss commented on how I got done more than all of the full-timers there.
I personally think the biggest benefit to every company would be to drill into people's heads how software should automate your day to day work. Software people think that way, but most employees don't.
>>Automate your own tasks and do not tell anybody. Have a chilled out life!
Many years ago there was a post on an obscure online forum about some guy who hired virtual assistants do to 100% of his work for him for a tiny, tiny fraction of his salary. I don't remember the details, but he would basically go to work and do nothing all day. After a while he started staying at home, and no one at his company even noticed.
No, I do not consult, I am a normal employee working as a data scientist in business intelligence. By jump ship I mean I went back to a small company I used to work for in the past. The VP of IT knows me (my unpleasant side too) and he needed someone impatient like me interested more in doing than in talking.
I do not know anybody doing consulting/contracting here in Germany, it seems to be an uncommon thing. I wish I would know how to get into it.
Nothing fancy. I was in the BI department of a big telco and I inherited a "next best offer" system. It was extracting data from the DWH, doing some scorecard based optimization, picking the right product for the right customer and sending the results to the call centers. The data extraction part was a PL/SQL framework and the optimization was done by a SAS tool. The system was really slow: after a change in the parameters it took 48 hours to recalculate the results. Unfortunately the product line managers loved to change the parameters on the day of the data delivery and my team lead couldn't say "no". So after a couple of month I ended up doing almost everything manually in order to keep the product line managers happy and to keep the deadlines. Practically I took the system step by step to pieces and I worked with standalone SQL scripts, like back in the 90's. After a lot of people were fired and my team lead resigned I was left alone for two months. There was practically nobody to require urgent changes so I used my time to rewrite almost everything from scratch, included the features the product line managers wanted and reduced my monthly workload from 25 days to 3. And I didn't tell about it.
I think one major issue is that manual processes often don't really "hurt" managers, they hurt the people doing them. To a developer or ops admin, "This $badthing caused by a typo won't happen again if we automate this" sounds very reasonable but sometimes managers just see it as a mistake that someone will need to be more careful about. Once they've factored the turnaround time into how they estimate they don't seem as interested in speeding things up. All that seems exacerbated by reactionary/feature driven mindsets which makes any kind of improvement that doesn't have an external event/person driving it very hard to get slotted. This seems to be made worse if you're working with a manager that's never really done the work that the people they're managing do or they did it so long ago they don't have an intuitive understanding of how it works today.
Another one is that a lot of people who perform a manual process for a long period of time become invested in it and defensive of it. No matter how much faster or better it is and no matter how involved they are if they end up feeling threatened it's probably dead in the water. Pretty typical human nature thing I think but at a big company with a lot of old established manual processes this can slow automation efforts down to a glacial crawl. Even if there's only one person that fully understands it I don't think managers appreciate the risk of having all of your eggs in one basket.
Eventually things do get automated but it seems like it's driven by a disaster or politics more than anything else. And sometimes not even disaster seems to be enough to drive real change if someone isn't pursuing it.
If anyone has tips on how to deal with any of this I'd love to hear them.