Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks?

We are witnessing a major shift in the process of generating images. The recent influx and growth of machine learning and artificial intelligence raises questions about the way in which creative processes evolve and develop through technology. Systems like DALL-E, DALL-E 2, and Midjourney are AI programs trained to generate images from text descriptions using a dataset of text-image pairs. The diverse set of capabilities includes creating anthropomorphized versions of animals and objects, combining unrelated concepts in plausible ways, and applying transformations to existing images.

Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks? - Image 2 of 8Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks? - Image 3 of 8Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks? - Image 4 of 8Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks? - Image 5 of 8Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks? - More Images+ 3

DALL-E and similar systems are able to create plausible images for a great variety of sentences that explore the compositional structure of language. DALL-E has some of the capabilities of a 3D rendering engine, but the difference lies in the nature of inputs. For 3D rendering, the input must be specified in complete detail, while DALL-E is often able to “fill in the blanks”. It can also independently control the attributes of a small number of objects.

Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks? - Image 5 of 8
These are the four initial results generated by Midjourney bots based on the prompt: “/imagine A contemporary, sustainable McDonald’s restaurant made of glass with golden arches reflecting on a lake.” . Image © Leilah Stone / Midjourney AI via Metropolis

One of the most exciting features is the ability to combine unrelated concepts. This ability could have implications for the fields of architecture and design, as it for architecture and product design to take inspiration from seemingly unrelated concepts. The AI generative models encourage designers to explore a greater number of design possibilities from a new perspective, as it lowers the time between intention and execution. They offer an accessible way to play with data and generate imaginative variations of solutions to creative problems.


Related Article

The Metaverse as Opportunity for Architects: An Interview with Patrik Schumacher

Some researchers are calling these “Artificial serendipity”, systems that maximize the opportunity for serendipity, opening up the range of creative capabilities beyond the classical methods. Architects are already experimenting with these tools to explore complex issues like urban planning and the possibilities of existing spaces. Others are combining architectural keywords with contemporary design cliches, references to pop culture, and various art styles to design buildings or simply explore the nature of design trends and technology.

Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks? - Image 2 of 8
Canal Street is converted from a driving street to a walking street using AI. . Image © Google / Better Streets AI

While these models have limitations, the field is evolving at an unprecedented rate. Recently, Apple has released Gaudi, a “neural architect” that takes this process one step further by creating 3D scenes from text prompts like “go upstairs” or “go through the hallway”. It is hard to predict where these developments will take us, but their impact can already be felt. In the fields of architecture and design, these can be understood as powerful tools to explore, optimize, and test creative designs rapidly.

Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks? - Image 3 of 8
Material Tectonics Series. Image © Daniel Bolojan / Midjourney AI via Archipaper

Editor's Note: This article was originally published on August 15, 2022.

Image gallery

See allShow less
About this author
Cite: Maria-Cristina Florian. "Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks?" 31 Aug 2023. ArchDaily. Accessed . <https://www.archdaily.com/987228/can-artificial-intelligence-systems-like-dall-e-or-midjourney-perform-creative-tasks> ISSN 0719-8884

A Series of Houses. Image © Matias del Campo / Midjourney AI via Archipaper

人工智能是否拥有创造性?

You've started following your first account!

Did you know?

You'll now receive updates based on what you follow! Personalize your stream and start following your favorite authors, offices and users.