BLOOMTranslation site

BLOOM: Initiating Large-Scale...Multilingual open-source AI training modelsThe new eraBLOOM is a generative large-scale language model jointly developed by hundreds of AI researchers worldwide. It features a massive number of parameters, multilingual coverage, and openness, supporting 46 natural languages and 13 programming languages. The release of BLOOM symbolizes freedom and openness in AI research, and its powerful generative capabilities and applicability have garnered significant attention in the industry.

BLOOM's main functions

BLOOM is aAutoregressive Generative Large Language ModelEmploying a transformer architecture, it boasts a staggering 176 billion parameters and supports 46 natural languages and 13 programming languages. This AI training model was developed and trained by the BigScience Workshop on the Jean Zay supercomputer in France, aiming to promote a transparent, reusable, and open AI research ecosystem. Its advantages include:

• Multilingual supportIt covers English, French, Chinese, Hindi, Arabic, and other languages.
• Powerful generation capabilitiesIt can generate coherent, human-like text based on user prompts.
• Downstream task migrationIt is easy to fine-tune for NLP tasks such as summarizing, question answering, translation, and information extraction.
• Programming language compatibilityIt performs well in mainstream programming languages such as Python, Java, and C++.
• Fully open source/downloadableAnyone can accessHugging FaceGet it for free and deploy it.

For example, BLOOM can easily achieve the following functions (Source:Function page link）：

BLOOM's Data Diversity Statistics

BLOOM used a highly diverse corpus during its AI training process, specifically including the following table:

Chat endlessly with AI characters and start your own story.

Interact with a vast array of 2D and 3D characters and experience truly unlimited AI role-playing dialogue. Join now! New users receive 6000 points upon login!

How to play?Try it for free now →

For more model details, please seeOfficial Hugging Face documentation。

BLOOM's pricing and plans

As an open-source model, BLOOM's basic model is completely free, and anyone can download and deploy it locally via Hugging Face without paying any licensing fees.

The release of BLOOM follows the BigScience RAIL license, allowing individuals, research institutions, and social groups to use and modify it free of charge, but it must be explicitly prohibited from use in scenarios that violate ethics and laws. If cloud-based inference services, customized APIs, or enterprise-grade deployments are used, Hugging Face may offer separate paid options, but these are value-added services provided by cloud vendors and platform providers and do not conflict with the open-source nature of the BLOOM model itself.

For more pricing and deployment details, please visit [website address].Hugging Face pricing page。

How to use BLOOM

BLOOM is designed to be "useful out of the box," supporting multi-platform and multi-framework calls. Developers can use it in the following ways:

1. Direct download weights and tokenizersIt can be loaded and used locally using PyTorch/Transformers.
2. Direct cloud-based inference via the Hugging Face API (registration and API key required).
3. It supports fine-tuning/transfer learning to meet specific business needs.

Quick Use Example(See)Official Quick Start Guide）：

from transformers import AutoModelForCausalLM, AutoTokenizer tokenizer = AutoTokenizer.from_pretrained("bigscience/bloom") model = AutoModelForCausalLM.from_pretrained("bigscience/bloom") prompt = "Please briefly introduce the main functions of the BLOOM model." inputs = tokenizer(prompt, return_tensors="pt") outputs = model.generate(**inputs, max_new_tokens=100) print(tokenizer.decode(outputs[0], skip_special_tokens=True))

If you only need a small-scale trial, there are also interactive web demos available in Hugging Face Spaces.

Hardware Requirements Specification Table:

Who is BLOOM suitable for?

BLOOM is positioned as "open source, cutting-edge technology", and is therefore suitable for the following groups:

• Academic researchers and university faculty and studentsIt can be used for NLP research, result reproduction, model fine-tuning, etc.
• AI developers and engineersIntegrate into product prototypes and conduct AI capability verification.
• Multilingual application developers: Serving multinational corporations or linguistically diverse user groups.
• Data ScientistUsed for specific registers, domain knowledge extraction, and custom tasks.
• Open source community contributorsThis includes model optimization, evaluation, and development of supporting tools.
• Programming Education and Automation Tool DevelopersExperiment with AI code generation/completion functionality.

Application Instance Scope Reference Table:

For detailed information on suitable users and operating suggestions, please refer to [link/reference].Official documentation。

Highlights of BLOOM Technical Architecture and AI Training Model

Model architecture features

• It adopts a decoder-only structure, similar to GPT-3.However, it covers more languages and has better transfer and generalization capabilities.
• The number of parameters is up to 176 bytes, and it supports sequence lengths of up to 2048 tokens.The aim is to achieve a wider range of semantic understanding and generation.

refer to:More technical details

Diversity and fairness of AI training models

• Data coverage is extensiveIt includes 46 natural languages, 13 programming languages, and 1.6TB of high-quality text.
• Strong diversity design principleIt emphasizes proportional sampling of low-resource languages and stresses "open source, openness, and inclusivity".
• Model versions varyIn addition to the full version with 176B parameters, lightweight versions such as 7B1 and 3B are also available for users with limited resources.

BLOOM's Risks, Limitations, and Usage Recommendations

Limitations and risks must be faced squarely:

• Non-high-risk decision-making toolsThe model's content "seems reliable, but its accuracy needs to be verified," and it is not suitable for direct decision-making in scenarios such as biomedicine, finance, and law.
• May output harmful contentSuch as biased, aggressive, or using sensitive words.
• Strict adherence to ethical and data compliance is required.: Comply with the RAIL protocol and do not abuse it.

See details:Risk and Limitations Statement Document。

BLOOM Frequently Asked Questions

What are the different versions of the BLOOM model, and how do you choose between them?

BLOOM offers multiple parameter levels, ranging from micro-scale (bloom-560m) to ultra-large scale (bloom-176B).

• With limited hardware resources, we recommend choosing lightweight versions such as 7B or 3B.。
• For research and high-performance requirements, the full version of 176B can be used, but it requires distributed multi-GPU deployment.

For a detailed version list, please see：BLOOM Model List

Can bloom be used in commercial products?

Under the open-source RAIL license, BLOOM can generally be used for commercial applications (as long as it is not illegal or used in high-risk/violation scenarios), but it is recommended to read the license agreement carefully to ensure that you do not violate any additional terms. For commercial calls to cloud APIs, additional fees will apply according to the Hugging Face platform's terms.

Can BLOOM be customized and fine-tuned? Is it useful for using custom data?

BLOOM is designed forTransferable/Fine-tunableThe AI training model has been developed, and the development team and community have provided various practical solutions for fine-tuning. Based on the publicly available Transformers toolkit, developers can quickly adapt BLOOM to their own datasets for downstream tasks such as classification, annotation, and generation.

Fine-tuning tutorial/practical guide: (For reference)Official documentationAnd community sharing.

End

BLOOM has become a milestone in promoting the democratization of NLP and open collaboration in AI. Its multilingual capabilities and open ecosystem have created unprecedented fertile ground for innovation for global developers and AI training model enthusiasts. Whether it's scientific research experiments, language diversity protection, or intelligent product prototype development, BLOOM provides you with a flexible, professional, open, and high-performance new paradigm for AI. If you are interested in experiencing the power of cutting-edge AI, visit [website name] now.BLOOM Official DocumentationEmbark on your exploration journey and work together to promote the prosperity and development of AI technology.

Chat endlessly with AI characters and start your own story.

Interact with a vast array of 2D and 3D characters and experience truly unlimited AI role-playing dialogue. Join now! New users receive 6000 points upon login!

How to play?Try it for free now →