AIThis post was created with the assistance of artificial intelligence (AI).

TL;DR

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get the latest gadgets delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Thinking Machines unveiled Inkling, a large open-weight AI model with 975 billion parameters, available on Hugging Face under Apache 2.0 license. This marks a shift toward more transparent, owner-controlled AI, though some restrictions may apply.

Thinking Machines has released its first foundation model, Inkling, openly available on Hugging Face under the Apache 2.0 license. This marks a significant shift in AI development, emphasizing model ownership and transparency over proprietary control.

Inkling is a Mixture-of-Experts transformer with 975 billion total parameters and 41 billion active, supporting a 1-million-token context window. It was pretrained on 45 trillion tokens across text, images, audio, and video, with a natively multimodal input design that processes text, images, and audio jointly without a vision adapter. The model was trained using a hybrid optimizer on NVIDIA systems, with over 30 million reinforcement learning rollouts improving reasoning performance.

The weights are released under Apache 2.0 license, allowing download, modification, and commercial use. However, reports indicate that Thinking Machines maintains a separate Model Acceptable Use Policy restricting surveillance, deception, and automated decision-making affecting individuals, which could limit the open-source nature of the model in practice. The full training data and pipeline are not publicly disclosed, a common industry norm but a point of contention for transparency advocates.

At a glance
breakingWhen: announced April 2024
The developmentThinking Machines publicly launched Inkling, a 975-billion-parameter foundation model, openly available on Hugging Face, signaling a move toward open ownership in AI development.

Implications of Open-Weight AI Models for Industry

This release signifies a shift toward greater model ownership and transparency in AI development, allowing organizations to host and modify models independently. It challenges the traditional proprietary approach, potentially accelerating innovation and reducing reliance on closed APIs. However, the existence of a separate use policy raises questions about the true openness and enforceability of restrictions, making its long-term impact uncertain.

Amazon

AI model training hardware

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background of Open-Weight AI Model Releases

Until now, most large foundation models have been released as proprietary or with limited access, often via closed APIs. The recent trend has been toward commercial licensing, with some exceptions providing open weights but accompanied by restrictions. The release of Inkling under Apache 2.0 marks a notable departure, emphasizing model ownership and transparency. Historically, open models like GPT-2 and GPT-3 variants have influenced industry standards, but the scale and multimodal capabilities of Inkling represent a new frontier in open AI development.

“We believe in providing the community with powerful tools while maintaining responsible use policies.”

— Thinking Machines spokesperson

Amazon

multimodal AI development tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Questions About the Model’s Use Restrictions

It remains unclear how the separate Use Policy will be enforced and whether it will significantly limit the practical openness of Inkling. The policy reportedly prohibits surveillance, deception, and certain automated decisions, but the exact scope and enforceability are not publicly verified. Additionally, the full training data and pipeline are not disclosed, raising questions about transparency and reproducibility.

Amazon

large open-source AI models

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Next Steps for Industry Adoption and Testing

Expect independent researchers and organizations to test and benchmark Inkling across various tasks, verifying claims and exploring its capabilities. Further details on the use policy and training data are anticipated, alongside potential updates or restrictions. Industry observers will monitor how the model’s open weights influence broader AI development and ownership models in the coming months.

Amazon

AI model licensing and management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

What makes Inkling different from other large AI models?

Inkling is notable for being openly available under the Apache 2.0 license, with full weights released publicly. It also features a multimodal, 975-billion-parameter architecture supporting a one-million-token context window, designed for flexible ownership and deployment.

Are there any restrictions on how I can use Inkling?

While the weights are openly licensed, reports suggest that Thinking Machines has a separate Acceptable Use Policy that restricts surveillance, deception, and certain automated decisions. The enforceability and scope of these restrictions are still unverified and require careful review before use.

Why is open licensing important for AI models?

Open licensing allows organizations to host, modify, and deploy models independently, reducing reliance on proprietary APIs. It fosters innovation, transparency, and potentially safer development by enabling community oversight and verification.

What are the potential risks of open-weight models?

Open weights can be misused for malicious purposes, such as generating disinformation or automating surveillance. Without clear, enforceable use restrictions, there is a risk of harm, especially if the model is used in sensitive domains.

What will happen next in the development of open AI models?

Researchers will benchmark Inkling’s performance, verify claims, and explore its capabilities. The industry will watch for updates on use policies, training data transparency, and how open-weight models influence AI ownership and safety standards.

Source: ThorstenMeyerAI.com

EVERGREEN BESTSE

Evergreen bestsellers Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Two Channels: How the Pentagon Just Split Frontier-AI Procurement in Half

The Pentagon has split its AI procurement into two distinct channels, placing Anthropic in a strategic, exclusive track while continuing multi-vendor classified projects.

Super Apps: Will One App Replace All Others on Your Phone?

What if one app could handle everything on your phone, but are there reasons it might not fully replace others?

The Future Of Europe’s AI Strategy Might Be In Canada

European Commission’s proposal hints at deepening ties with Canada for AI development, offering strategic independence and ecosystem expansion.

Unlocking AI Potential: ByteDance Builds New Data-Oriented AI Team

ByteDance has reportedly created a new AI organization centered on data, expanding its AI operations after Seed and Flow, though details remain undisclosed.