Weekly Newsletter, IT with Business Outcomes, Vol 3


Hello Leaders,

Artificial Intelligence is gaining momentum every week and continues to hog the headlines. The three we hand picked are to highlight the challenges you need to prepared for a) to avoid compliance issues and b) to keep your team members' wellbeing in mind.

1. Over dependence on AI can lead to deterioration of cognitive skills

No one can dispute that any skill will deteriorate when it is not used. As our responsibilities shift with AI, our cognitive faculties could deteriorate. This was confirmed by a study conducted by Microsoft and Carnegie Mellon University. They surveyed 319 knowledge workers and collected 936 examples of tasks being completed using Generative AI. Key implications of the research are

  • Decision making. As we rely more on AI for decision making, we will get fewer opportunities to practice judgement. When something goes wrong and manual takeover is necessary, we won’t be able to effectively troubleshoot without wide knowledge of the overall system.
  • Critical Thinking. AI tools produce homogeneous recommendations for a given task. As a result, the outputs we are producing using AI are less diverse. We will get less opportunity to exercise creativity, reflect their views, or think critically.
  • Hands on Experience. With AI automating many tasks, our responsibilities are shifting from production to verification. For example, a software developer will spend less time writing code and more time verifying. This will limit our hands-on-experience which will further limit their ability to put ideas into practice.
  • Writing. Novice writers are bypassing the creative writing process when they rely too much on Generative AI. They are not learning the skills to construct logical arguments or spending the time to understand the subject matter.
  • Memory. There is fear that using AI for search and summarization will reduce the ability to research and learn from the high quality papers and literature.


Further, when we don't use our own labor to complete a task, would we get the sense of satisfaction or accomplishment?

Actions you can take

Instead of focusing on speed, prioritize the use of AI to

  • improve quality,
  • mitigate negative consequences of AI generated output,
  • augment the capabilities of your team members,
  • etc.

Further Reading

https://www.microsoft.com/en-us/research/uploads/prod/2025/01/lee_2025_ai_critical_thinking_survey.pdf

2. Privacy risk with AI notetakers

People are increasingly relying on AI notetakers to transcribe the entire meeting. Your external partners and vendors are inviting the AI notetakers to the meetings.

  • This makes it very difficult to have any off the record conversations.
  • Words could be taken out of context and used against individuals.
  • Makers of the note taking apps will now have “free” training data from our conversations
  • Over reliance on these tools will degrade the cognitive skills that we have relied on for centuries.

Actions you can take

  • Encourage in-person engagements to brainstorm ideas
  • Prohibit the use of note taking apps for all external meetings.
  • Prohibit its use for internal meetings related to confidential topics, individual’s performance, customer, etc.

Further Reading

https://www.bloomberg.com/news/articles/2025-02-14/ai-notetakers-in-meetings-are-making-me-queasy

3. Are your LLMs safe?

Hackers continue to find new ways to dupe the LLMs in revealing sensitive information. One researcher injected prompts into Google’s Gemini and OpenAI’s ChatGPT to permanently plant instructions in its long-term memory. This could potentially be use to instruct the bot to perpetually act on false information. Last August, a similar demonstration was made to target Microsoft Copilot.


Actions you can take

  • Educate your team about different types of attack. The following site explains different types of attacks using examples -
  • Evaluate and implement Prevention techniques

Disclaimer: The links above are not endorsement of any product or company; they are for educational purpose only.

Further Reading

https://arstechnica.com/security/2025/02/new-hack-uses-prompt-injection-to-corrupt-geminis-long-term-memory/?comments-page=1#comments

Agile C-Level

IT leaders are busy and do not have enough time to research and keep up with the latest trends and events that might affect them. The goal of the newsletter is to analyze these trends and events to present actionable items to these leaders.

Read more from Agile C-Level

Hello Leaders, We hope you have adjusted to the time change. However, it will hard to keep up with the speed at which AI is evolving. That's why we are reviewing dozens of headlines to highlight a handful that your IT leadership must act on. 1. Another AI product that has taken the Internet by storm Manus is another AI from China. Unlike the other AI products, this is a general purpose autonomous AI agent which can perform many tasks. It combines many AI models and tools to accomplish a range...

Hello Leaders, With the daylight savings returning this weekend, you will lose an hour of sleep. However, we don't want you to lose sleep over missing critical news. That's why we are reviewing dozens of headlines to highlight a handful that your IT leadership must act on. 1. Search engines and LLMs cache could expose your data Lasso, an Israeli cybersecurity company, discovered that contents of its private Github repositories were showing up in Microsoft’s Bing search engine. These...

Hello Leaders, Given the geopolitical situation, it is no surprise that state actors are trying innovative ways to steal confidential and sensitive information. Two of the three items in this week's newsletter are related to latest attack methods being used by the attackers. This reinforces the need for basic security hygiene which could be easily improved across the board. 1. Rethink your brand strategy in the AI World According to a Boston Consulting Group study, 28% of survey respondents...