Adobe Firefly

Adobe Firefly is a family of creative generative Artificial Intelligence (AI) models that are being integrated into Adobe products to provide a wide range of creative possibilities for users. These AI models can be utilized across various domains, including digital imaging, photography, illustration, graphic design, video, marketing, social media, and 3D modeling.

Features

Digital Imaging and Photography

Adobe Firefly aims to introduce context-aware image generation, allowing users to quickly experiment and refine their ideas. This feature can save creators significant time by instantly adding elements from their imagination into their compositions.

Illustration, Artwork, and Graphic Design

With Adobe Firefly, users will be able to generate custom vectors, brushes, and textures using simple language or sketches. This functionality will be integrated with existing Adobe tools, enabling seamless editing and customization of the generated assets.

Video

Firefly explores the potential of text-based video editing, allowing users to describe desired changes in mood, atmosphere, or weather and instantly apply those adjustments to their videos. This feature simplifies the process of modifying colors and settings in video content.

Marketing and Social Media

Adobe Firefly aims to simplify the creation of unique posters, banners, social posts, and more with simple text prompts. Additionally, users will be able to upload mood boards to generate completely original and customizable content.

3D Modeling

In the future, Adobe Firefly is expected to support the generation of photorealistic images from simple 3D compositions and facilitate the rapid creation of new styles and variations of 3D objects.

Adobe's Commitment to Responsible Generative AI

Adobe is dedicated to the responsible development of creative generative AI, prioritizing creators' needs and focusing on improving the creative process. As Firefly evolves, Adobe plans to continue collaborating with the creative community to ensure the technology remains supportive and beneficial to users.

Enhancing the Creative Process

Adobe Firefly seeks to expand users' natural creativity by providing generative AI tools specifically designed for creative needs, use cases, and workflows within Adobe products.

Providing Practical Advantages

After the beta stage, Adobe Firefly will offer commercial use options for generated content. Adobe also plans to develop different Firefly models tailored to various use cases, providing creators with more choices.

Setting Standards for Responsibility

Adobe is actively participating in initiatives like the Content Authenticity Initiative and Coalition for Content Provenance and Authenticity, which promote accountability, responsibility, and transparency in generative AI. Adobe is also working towards implementing a universal "Do Not Train" Content Credentials tag, ensuring that content creators can maintain control over the use of their work.

Research and Development

Adobe is continuously exploring new ways in which generative AI can help creators express their ideas. Some areas of research include:

Progressive Controllable Image Synthesis

This research area focuses on how simple marks, such as lines drawn with a stylus, can be combined with AI to produce desired results with minimal brushstrokes, simplifying the image editing process.

Customizable Diffusion

Customizable diffusion allows creators to select the images that inform the generative AI, providing more creative control over individual images and streamlining the application of creative choices across multiple works.

Generative Image Compositing

Generative image compositing simplifies the process of combining elements from multiple photos while maintaining a natural appearance. This AI-assisted approach reduces the time spent on adjustments such as color, shading, perspective, and shadows.

Firefly's Integration with Adobe Products

As Adobe Firefly is integrated with various Adobe products, creators will benefit from an enhanced user experience and improved creative workflows. Firefly will serve as a natural extension of Adobe's existing technology, aligning with the company's 40-year history of empowering individuals to bring their ideas to life.

Generative AI Technology

Generative AI is a form of artificial intelligence that uses ordinary language and other inputs to generate extraordinary results. While AI image and art generation has gained significant attention, generative AI can also create videos, documents, digital experiences, and creative building blocks such as brushes, vectors, and textures.

Ensuring Responsible AI-Generated Content

Adobe is committed to setting industry standards for responsible generative AI through the Content Authenticity Initiative (CAI). With over 900 members, the CAI leads the discussion around digital content attribution and offers open source tools and collaborative technical standards in partnership with the Coalition for Content Provenance and Authenticity (C2PA).

Content generated with Adobe Firefly will include an embedded Content Credentials tag, allowing AI-generated content to be easily distinguishable from non-AI-generated work.

Firefly's Data Sources

The current Firefly generative AI model is trained on a dataset consisting of Adobe Stock images, openly licensed works, and public domain content where copyright has expired. As Firefly develops, Adobe is exploring ways for creators to train the machine learning model with their assets, enabling them to generate content that aligns with their unique style, branding, and design language without the influence of other creators' content.

Adobe's Approach to AI Ethics

Adobe adheres to AI ethics principles of accountability, responsibility, and transparency in the development and deployment of generative AI. The company is committed to creating AI technology that respects customers and aligns with its values. Read more about Adobe's approach to AI ethics in their Adobe AI Ethics Blog Post.

Compensation for Adobe Stock Contributors

Adobe is in the process of developing a compensation model for Adobe Stock contributors whose content is used in the Firefly training dataset. Details of this compensation model will be released when Firefly exits the beta stage. For more information, consult the Adobe Stock FAQ.

Preventing Copyright Infringement

Adobe addresses copyright infringement concerns by training the initial Firefly model on Adobe Stock images, openly licensed content, and public domain content where copyright has expired. This approach aims to ensure responsible content generation.

The Content Authenticity Initiative and Firefly

The Content Authenticity Initiative (CAI) and Coalition for Content Provenance and Authenticity (C2PA) are working together to establish open industry standards and transparency around the origins, facts, and creators of digital content. Content generated using Firefly will include a Content Credentials tag stating that it was created with generative AI.

Adobe, in partnership with the CAI and C2PA, is also working towards a universal "Do Not Train" Content Credentials tag that will allow creators to opt-out of including specific content in generative AI training models. Adobe remains dedicated to collaborating with industry, government, and the creative community to develop and promote transparent, responsible, and creator-first AI standards.