Forward-looking: Real-time translation is frequently highlighted as one of the most useful applications of generative AI, and Microsoft intends to introduce this functionality to its video conferencing and team collaboration software early next year. The company also presented numerous new and upcoming AI features at its recent Ignite 2024 event.
Among the many Copilot “AI agents” that will soon be available in Microsoft 365 is a feature designed to translate speakers’ voices during meetings on Microsoft Teams. This function will be available for public preview in early 2025.
The supported languages include Mandarin, English, French, German, Italian, Japanese, Korean, Brazilian Portuguese, and Spanish.
Users can also command the agent to mimic their voice and speaking style in the translated language. Additionally, a new AI transcription feature in Teams accommodates translations into 31 languages. Another translation tool, set to launch next year, will allow Copilot to convert entire PowerPoint presentations into one of 40 languages without altering their formatting.
Microsoft’s new Copilot enterprise agents – essentially customizable AI-based apps – were first introduced a month ago. Initially designed to automate various tasks for sales and finance companies, a new wave of these agents will be deployed to other industries from now until early 2024.
For instance, Copilot will soon be able to recap Microsoft Teams discussions, respond to participant questions, and summarize shared files in chat. A feature launching later this month will enable Copilot to schedule one-on-one meetings by assessing users’ calendars, identifying mutually available times, and drafting meeting agendas.
Agents have also been integrated into Microsoft’s SharePoint tools. A new AI assistant can gather information about a company and its products to aid customers, train new team members, or plan budgets. Moreover, 365 subscribers will be able to implement SharePoint Advanced Management at no additional cost beginning in early 2025.
ServiceNow, Workday, Cohere, and other companies are also gearing up to release more AI agents in the coming months. Meanwhile, Copilot’s data access capabilities are expected to expand through collaborations with companies like S&P Global and CB Insights.
Microsoft’s Ignite 2024 announcements suggest that the company is placing significant emphasis on GenAI. However, features such as translation, summaries, and queries depend on accuracy – a consistent challenge for AI due to the well-documented issues of hallucinations.
Salesforce CEO Marc Benioff strongly criticized Microsoft’s initial Copilot Agent deployment, pointing to inadequate accuracy, data, and security. However, Salesforce is attempting to compete with its Agentforce AI tools. The recent launch of Apple Intelligence has raised questions about generative AI summaries, as numerous unintentionally amusing results have circulated on social media.
Microsoft asserts that restricting AI agents to information sourced from user-determined datasets will ensure accuracy. The forthcoming public betas will challenge that assertion.
