Usage of flying dog Plugin on DALL-E 2 (recommended)

1. Start with Configuration of DALL-E 2


Login with your OpenAI/DALL-E 2 account here:
https://beta.openai.com/account/api-keys

Click on
 


Copy the Key and go to the plugin panel, Click on “Add “DALL-E 2”

In Configuration paste that key from Clipboard.
Please make sure that you your billing:
https://beta.openai.com/account/billing/overview

Existing DALL-E 2 credits will be ignored.

2. Main Panel

The main panel offers access to different configurations in top menu and also offers buttons for each functions:

  1. From Text: generate an Image from a text prompt only
  2. Variations: upload an existing image a for generating variations of it
  3. In-/Outpaint: Powerful editing features for adding objects in the scene or extend the whole image

2. Text to Image

Prompt: enter whatever you want to see in text input (e.g. "a cat in suit" or just “ a duck” like in the screenshot).

Please check the DALL·E - Content Policy FAQ So there might be an unexpected error coming up from the DALL-E 2 content filter.

We have separated the so called modifiers from main prompt input. And so you can  define modifiers for individual styles below prompt input. You can also manage your own library with modifiers. Each list of modifiers can be assigned to tags which can be selected at the top as category:

Switch to Modifier ideas for a quick selection of styles:

So with that separation you can quickly change the style of a prompt with manually typing or copy/paste a long string again.

We also implemented to comment out a line in modifier box:

In this example "pastel colored" will not be part of the full prompt.

Other parameters

Number of images: generate between 1 and 4 images. DALL-E 2 has not all the properties of Stable-Diffusion but also offers great results.

3. Task list

In the  main panel all image generation tasks are shown. Also multiple tasks can be started for DALL-E 2 at the same time.  

Note: The task list is only temporary and will be empty after Photoshop or plugin restart.




Please keep beta limitations in mind, from the OpenAI guide:
 “The Images API is in beta. During this time the API and models will evolve based on your feedback. To ensure all users can prototype comfortably, the default rate limit is 10 images per minute, 25 per 5 minutes. If you would like to increase your rate limit, please review this help center article. We will increase the default rate limit as we learn more about usage and capacity requirements.”

4. Images Preview

After starting image Generation you will see a preview window. Here you can select an image.
The following example (“dinosaur having an important business meeting, stock photography, highly detailed”) shows also the powerful capabilities to generate more complex scenes:

Click On “layer Preview” for Inline-Preview of images on canvas:

Now you can browse through the images and Select the current one as well.

For this preview a temporary layer group “_ai” will be generated.

4. Variations

The image at selection is used as the basis for variations of it. There are no parameters in this mode and no text prompt is asked. Only the selected images will be used for this feature.

5. Inpainting and Outpainting

With Inpainting a part of an existing image can be changed. There are the following variations of this technique in DALLE-2 supported:

1. Normal Inpainting

First remove a part of an image. Then make a selection big enough that AI can understand the surroundings and close enough to have good resolution. Also the erased part should match the prompt. Otherwise the object in Inpaint might be cut off at the edges or not shown at all.
Note: make sure to use a hard (100% hardness) eraser in pencil mode here otherwise you will get weird black border:


Successful Inpainting:

2. Outpainting

DALL-E 2 offers state-of-the-art Outpainting. But it has the same limitations because it uses only a part of an image for extending it. So it does not know the whole context.

To keep a consistent image:

3. Uncrop

It is a variation of Outpainting where three or four sides will be extended which works fine with that large image size of DALL-E 2. A common example is to use a previous generated close-up of a face/head and scale it down to around ⅓ and do Outpainting of all 4 sides to get more of the body and background.

6. Server Configuration dialog (advanced reading)

Size

Use 1024x1024 (recommend) or 512x512

M1 Fix

There is a bug in Photoshop which does not allow image operations while having a dialog open. So it is recommended to check this box if you are using a M1 Mac.