How Baidu's AI Produces News Videos Using Just a URL

An anonymous reader shares a report:

AI for news production is one of the areas that has drawn contrasting opinions. On one hand, it might help media houses produce more news in a better format with minimal effort, on the other, it might take away the human element of journalism or take people out of jobs. In 2018, an AI anchor developed by China’s Xinhua news agency made its debut. Earlier this month, the agency released an improved version that mimics human voices and gestures. There’s been advancement in AI with text-based news with algorithms writing great headlines. China’s search giant Baidu has developed a new AI model called Vidpress that brings video and text together by creating a clip based on articles.

The company has currently deployed Vidpress on its short videos app Haokan and only works with Mandarin language. It claims that the AI algorithm can produce up to 1,000 videos per day, which is a whole lot more than the 300-500 its human editors are currently putting out. Vidpress can create a two-minute 720p video in two and a half minutes, while human editors take an average of 15 minutes to do that task. To train this model, Baidu used thousands of articles online to understand context of a news story. Additionally, the company had to train AI models for voice and video generation separately. However, in the final step, the algorithm syncs both streams for a smooth final video. When you feed the AI algorithm a URL, it automatically fetches all related articles from the internet and creates a summary.

1 Like