Guide to IP Adapters in Game Design

There are many ways to use IP Adapters, here are some tips to get you started

To use IP Adapters:

1. Add image to the Reference Image section.

2. Switch to IP Adapters (or one of the + IP Adapters options.)

3. Adjust the influence as needed.

Screenshot 2024-02-12 at 12.30.47 PM

 

GF-e_88WoAEeGMP

The Model you use matters

If you want your character or creation to be in the same style*as your reference image, you must train or pick a model in the same style or a close stylistic match.

YOU DO NOT NEED COMPLEX PROMPTS.

IP Adaptors are Image Prompts. It is taking into context what it senses from your image.

If you have a portrait of a woman as your reference image, you probably don't need to say "portrait of a woman in the prompt" unless you're having trouble making a woman appear.

The prompts I use are super simple. Like this:

  • Running
  • Laughing
  • Break Dancing
  • Doing Kung Fu
GF-gZXrXAAAzy1C
GF-ga5bWwAAi2uj

IP ADAPTERS WORK BETTER FOR NON-REALISM

This is an unfortunate truth, and one we are investigating more, but do not expect the IP Adapters to work quite as magically for photorealistic images.

THE INFLUENCE IS VARIABLE

AI relies on Probability.

As a general rule of thumb, 0.50 influence is a good starting off point.

However, depending on how much the model associates the image you use with the model you are prompting from, you may need to go much higher or lower in influence.

  • If you use an image of a portrait, you may find that you need to heavily adjust the influence to create full body images.
  • If you use a lot of prompts, you may need to really increase the influence of your image.

IP ADAPTERS + IMAGE to IMAGE or CONTROLNET

We could, and will, write a whole article on IP Adapters and other reference image control methods together. They can be super powerful.

The easiest, most direct method to try this out is by using a portrait in the IP Adapter and a Pose with ControlNet (Character Mode).

GF-iL40XMAAfZ3k
GF-iL4zXEAA0ARZ

 

GF-iOF7XoAAtc-D

Table of content

You'll also like