• Home
  • About Us
  • Contact Us
  • Privacy Policy
  • Special Offers
Business Intelligence Info
  • Business Intelligence
    • BI News and Info
    • Big Data
    • Mobile and Cloud
    • Self-Service BI
  • CRM
    • CRM News and Info
    • InfusionSoft
    • Microsoft Dynamics CRM
    • NetSuite
    • OnContact
    • Salesforce
    • Workbooks
  • Data Mining
    • Pentaho
    • Sisense
    • Tableau
    • TIBCO Spotfire
  • Data Warehousing
    • DWH News and Info
    • IBM DB2
    • Microsoft SQL Server
    • Oracle
    • Teradata
  • Predictive Analytics
    • FICO
    • KNIME
    • Mathematica
    • Matlab
    • Minitab
    • RapidMiner
    • Revolution
    • SAP
    • SAS/SPSS
  • Humor

OpenAI launches Neural MMO, a massive reinforcement learning simulator

March 4, 2019   Big Data

Artificial intelligence that’s beastly at World of Warcraft might not lie too far into the distant future, if OpenAI has its way. The San Francisco research nonprofit today released Neural MMO, a “massively multiagent” virtual training ground that plops agents in the middle of an RPG-like world — one complete with a resource collection mechanic and player versus player combat.

“The game genre of Massively Multiplayer Online Games (MMOs) simulates a large ecosystem of a variable number of players competing in persistent and extensive environments,” OpenAI wrote in a blog post. “The inclusion of many agents and species leads to better exploration, divergent niche formation, and greater overall competence.”

AI agents spawn randomly in Neural MMO environments, which contain automatically generated tile maps of a prespecified size. Some tiles are traversable, like “forest” (which bears food) and “grass,” while others aren’t (such as water and stone). Agents observe the square crops of tiles centered on their respective positions and make one movement and one attack per timestamp (or tick), tackling tasks like foraging for limited “food” and “water” resources (by stepping on forest tiles or next to water tiles) and engaging in combat (“melee,” “range,” and “mage”) with other agents.

 OpenAI launches Neural MMO, a massive reinforcement learning simulator

OpenAI used Neural MMO to train an AI system by rewarding agents for their lifetime — i.e., how long they managed to stay alive — and found that the longer the agents interacted with each other, the better they became at certain tasks, and that increasing the maximum number of concurrent agents “magnified” their exploration. Intriguingly, they also found that increasing the agents’ population size prompted them to spread out within different parts of the map and that agents trained in larger settings “consistently” outperformed those trained in smaller settings.

“As entities cannot out-compete other agents of their own population (i.e. agents with whom they share weights), they tend to seek areas of the map that contain enough resources to sustain their population,” OpenAI wrote. “In the natural world, competition among animals can incentivize them to spread out to avoid conflict. We observe that map coverage increases as the number of concurrent agents increases. Agents learn to explore only because the presence of other agents provides a natural incentive for doing so.”

Neural MMO, available on GitHub, is designed to support a large number of agents (up to 128 in each of 100 concurrent servers). It packs in baselines (trained on over 100 worlds) against which the agents’ performance can be compared, and the computational overhead is relatively low — training only requires a single desktop CPU.

It’s far from the first of its kind, it’s worth noting. In December, OpenAI released CoinRun, a classic platformer designed to measure agents’ ability to transfer their experiences to unfamiliar scenarios. And in August, researchers at the University of Adger in Norway open-sourced an environment for AI training in real-time strategy games.

Beyond simulated learning environments, data scientists have set loose AI on Starcraft II, Montezuma’s Revenge, Dota 2, Quake III, and other games, all in pursuit of systems that might one day diagnose illnesses, predict complicated protein structures, and segment CT scans. “The reason we test ourselves and all these games is … that [they’re] a very convenient proving ground for us to develop our algorithms,” DeepMind cofounder Demis Hassabis told VentureBeat in a recent interview. “Ultimately, [we’re developing algorithms that can be] translate[ed] into the real world to work on really challenging problems … and help experts in those areas.”

Let’s block ads! (Why?)

Big Data – VentureBeat

Launches, Learning, massive, neural, OpenAI, reinforcement, simulator
  • Recent Posts

    • Accelerate Your Data Strategies and Investments to Stay Competitive in the Banking Sector
    • SQL Server Security – Fixed server and database roles
    • Teradata Named a Leader in Cloud Data Warehouse Evaluation by Independent Research Firm
    • Derivative of a norm
    • TODAY’S OPEN THREAD
  • Categories

  • Archives

    • April 2021
    • March 2021
    • February 2021
    • January 2021
    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • August 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • March 2020
    • February 2020
    • January 2020
    • December 2019
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • April 2019
    • March 2019
    • February 2019
    • January 2019
    • December 2018
    • November 2018
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • February 2017
    • January 2017
    • December 2016
    • November 2016
    • October 2016
    • September 2016
    • August 2016
    • July 2016
    • June 2016
    • May 2016
    • April 2016
    • March 2016
    • February 2016
    • January 2016
    • December 2015
    • November 2015
    • October 2015
    • September 2015
    • August 2015
    • July 2015
    • June 2015
    • May 2015
    • April 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
© 2021 Business Intelligence Info
Power BI Training | G Com Solutions Limited