Hello! Welcome back to On Tech: A.I., a pop-up newsletter that teaches you about artificial intelligence, how it works and how to use it.
In last weekās newsletter, I shared the golden prompts for getting the most helpful answers from chatbots like ChatGPT, Bing and Bard. Now that youāre familiar with the general principle of building a relationship with A.I. ā the more specific and detailed instructions you give, the better results youāll get ā letās move on to a slightly different realm.
Much of the hype and fears around generative A.I. has been about text. But there have also been rapid and dramatic developments in systems that can generate images. In many cases, these share a similar structure to text-based generative A.I., but they can also be much weirder ā and lend themselves to some very fun creative pursuits.
Image generators are trained on billions of images, which enable them to produce new creations that were once the sole dominion of painters and other artists. Sometimes experts canāt tell the difference between A.I.-created images and actual photographs (a circumstance that has fueled dangerous misinformation campaigns in addition to fun creations). And these tools are already changing the way that creative professionals do their jobs.
Compared to products like ChatGPT, image generating A.I. tools are not as well developed. They require jumping through a few more hoops, and may cost a bit of money. But if youāre interested in learning the ropes thereās no better time to start.
A.I. Photoshop
Last week, Adobe added a generative A.I. feature into a beta version of Photoshop, its iconic graphics software, and creators on social networks like TikTok and Instagram have been buzzing about it ever since.
I have a fair amount of experience with Photoshop. When I tested the new feature, called āgenerative fill,ā I was impressed with how quickly and competently the A.I. carried out tasks that would have taken me at least an hour to do on my own. In less than five minutes and with only a few clicks, I used the feature to remove objects, add objects and swap backgrounds.
(To experiment with these tools yourself, start by signing up for a free trial of Adobe Creative Suite. Then, install the new Adobe Photoshop beta, which includes generative fill.)
Once you have Photoshop beta installed, import a photo and try these tricks:
-
To change a background, click the āobject selectionā icon (it has an arrow pointed at a box), then under the Select menu, click āinverseā to select the background. Next click the āgenerative fillā box and type in a prompt ā or leave it blank to let Photoshop come up with a new background concept for you.
I used these steps to edit a photo of my corgi, Max. I typed ākennelā for the prompt, and clicked āgenerate” to replace the background. Hereās the before (left) and after.
Photo editors at The New York Times do not enhance or alter photos, or generate images using artificial intelligence. But my first thought after testing generative fill was that photo editors working in other contexts, like marketing, could be soon out of work. When I shared this theory with Adobeās chief technology officer, Ely Greenfield, he said that it might make photo editing more accessible, but he was optimistic that humans would still be needed.
āI can make really pretty images with it, but frankly, I still make boring images,ā he said. āWhen I look at the content that artists create when you put this in their hands versus what I create, their stuff is so much more interesting because they know how to tell a story.ā
I confess that what Iāve done with generative fill is far less exciting than what others have been posting on social media. Lorenzo Green, who tweets about A.I., posted a collage of famous album covers, including Michael Jacksonās āThrillerā and Adeleās ā21ā that were expanded with generative fill. The results were quite entertaining.
(One note: If installing Photoshop feels daunting, a quicker way to test Adobeās A.I. is to visit the Adobe Firefly website. There, you can open the generative fill tool, upload an image and click the āaddā tool to trace around a subject, such as a dog. Then click ābackgroundā and type in a prompt like ābeach.ā)
More image generators
Tools like DALL-E and Midjourney can create entirely new images in seconds. They work similarly to chatbots: You type in a text prompt ā the more specific, the better.
To write a quality prompt, start with the medium youād like to emulate, followed by the subject and any extra details. For example, typing āa photograph of a cat wearing a sweater in a brightly lit roomā in the DALL-E prompt box will generate something like this:
DALL-E, which is owned by Open AI, the maker of ChatGPT, was one of the first widely available A.I. image generators that was simple for people to use. For $15, you get 115 credits; one credit can be used to generate a set of four images.
Midjourney, another popular image generator, is a work in progress, so the user experience is not as polished. The service costs $10 a month, and entering prompts can be a little more complicated, because it requires joining a separate messaging app, Discord. Nonetheless, the project can create high-quality, realistic images.
To use it, join Discord and then request an invitation to the Midjourney server. After joining the server, inside the chat box, type ā/imagineā followed by a prompt. I typed ā/imagine a manga cover of a corgi in a ninja turtle costumeā and generated a set of convincing images:
Though itās fine to type in a basic request, some have found obscure prompts that generated exceptional results (Beebom, a tech blog, has a list of examples). At Columbia University, Lance Weiler is teaching students how to leverage A.I., including Midjourney, to produce artwork.
Whichever tool you use, bear in mind that the onus is on you to use this tech responsibly. Technologists warn that image generators can increase the spread of deepfakes and misinformation. But the tools can also be used in positive and constructive ways, like making family photos look better and brainstorming artistic concepts.
Whatās next?
Next week, Iāll share some tips on how to use A.I. to speed up aspects of office jobs, such as drafting talking points and generating presentation slides.
In case youāre wondering, the delightfully demented image at the top of this newsletter was created by a human ā the illustrator Charles Desmarais ā not by A.I.