svjack's picture
Update README.md
b4832c3 verified
# LoRA Fine-tuned Kontext Model for Artistic Style Transfer
This repository provides a **LoRA (Low-Rank Adaptation)** fine-tuned variant of the Kontext image consistency model, optimized for transforming images into 22 distinct artistic styles while preserving content consistency.
---
## 🎨 Supported Art Styles
- can refer on https://github.com/showlab/OmniConsistency
| Style Category | Example Prompt | Visual Characteristics |
|----------------|----------------|------------------------|
| **3D Chibi Style** | `transform it into 3D Chibi style` | Exaggerated cute proportions with three-dimensional rendering and soft shading |
| **American Cartoon Style** | `transform it into American Cartoon style` | Bold outlines, vibrant colors, and exaggerated expressions typical of Western animation |
| **Chinese Ink Style** | `transform it into Chinese Ink style` | Flowing brushstrokes, monochromatic tones, and traditional shan shui aesthetics |
| **Clay Toy Style** | `transform it into Clay Toy style` | Matte textures with visible fingerprints and soft plasticine-like appearance |
| **Fabric Style** | `transform it into Fabric style` | Woven textile appearance with stitch details and cloth-like folds |
| **Ghibli Style** | `transform it into Ghibli style` | Soft watercolor-like backgrounds, expressive eyes, and whimsical Studio Ghibli aesthetic |
| **Irasutoya Style** | `transform it into Irasutoya style` | Clean vector graphics with flat colors and simple shapes (Japanese clipart style) |
| **Jojo Style** | `transform it into Jojo style` | Dynamic "bizarre" poses, exaggerated muscles, and dramatic manga shading |
| **LEGO Style** | `transform it into LEGO style` | Blocky construction with cylindrical hands and studded surfaces |
| **Line Style** | `transform it into Line style` | Minimalist continuous-line drawings with negative space emphasis |
| **Macaron Style** | `transform it into Macaron style` | Pastel colors with soft gradients and candy-like textures |
| **Oil Painting Style** | `transform it into Oil Painting style` | Visible impasto brushstrokes and rich pigment textures |
| **Origami Style** | `transform it into Origami style` | Geometric folded paper appearance with crisp edges |
| **Paper Cutting Style** | `transform it into Paper Cutting style` | Silhouette art with intricate negative space patterns |
| **Picasso Style** | `transform it into Picasso style` | Cubist fragmentation and abstract facial rearrangements |
| **Pixel Style** | `transform it into Pixel style` | 8-bit/16-bit retro game aesthetic with visible square pixels |
| **Poly Style** | `transform it into Poly style` | Low-polygon 3D models with flat-shaded triangular facets |
| **Pop Art Style** | `transform it into Pop Art style` | Ben-Day dots, bold colors, and high-contrast comic book styling |
| **Rick Morty Style** | `transform it into Rick Morty style` | Squiggly lines, grotesque proportions, and adult swim animation style |
| **Snoopy Style** | `transform it into Snoopy style` | Simple black-and-white comic strip aesthetic with round features |
| **Vector Style** | `transform it into Vector style` | Clean geometric shapes with gradient fills and sharp edges |
| **Van Gogh Style** | `transform it into Van Gogh style` | Swirling brushwork, thick impasto, and post-impressionist color fields |
---
## 🖼️ Style Transformation Examples
### Ghibli Style Transformation (爱豆翔)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FYSqHEgoMLoCWHB9r9rbL7.jpeg%3C%2Fspan%3E) | ![Ghibli](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FeryeU7hvA7gvkw1134gYU.jpeg%3C%2Fspan%3E) |
| *Prompt*: `transform it into Ghibli style` | *Characteristics*: Soft watercolor textures, expressive eyes |
### LEGO Style Transformation (吃冰淇凌的翔)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FvFOwrmTci1jmeoOA-NOw8.png%3C%2Fspan%3E) | ![LEGO](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FF6v_iyDz4MpGRCj6HQwVH.jpeg%3C%2Fspan%3E) |
| *Prompt*: `transform it into LEGO style` | *Characteristics*: Blocky construction with cylindrical hands and studded surfaces |
### 3D Chibi Style Transformation (包拯)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2F1tuBpVvprYA3LaZl10gcN.jpeg%3C%2Fspan%3E) | ![Chibi](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FKAPjcbO4FVvCnPf4Ny3UC.png%3C%2Fspan%3E) |
| *Prompt*: `transform it into 3D Chibi style` | *Characteristics*: Exaggerated cute proportions, 3D rendering |
### Oil Painting Style Transformation (拿破仑)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FfdrT28mSr5OsxvV04pXZ8.jpeg%3C%2Fspan%3E) | ![Oil Painting](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2F8qCwpJpyDpScGpY8eMXno.png%3C%2Fspan%3E) |
| *Prompt*: `transform it into Oil Painting style` | *Characteristics*: Visible brushstrokes, impasto texture |
### Jojo Style Transformation (叶卡捷琳娜)
| Source Image | Target Image |
|--------------|--------------|
| ![Original](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2Fhrw-jnm4cDoIOLr5DN0V-.jpeg%3C%2Fspan%3E) | ![Jojo](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FO09TlMIMNDcU7HuD-uL3T.png%3C%2Fspan%3E) |
| *Prompt*: `transform it into Jojo style` | *Characteristics*: Dynamic poses, bold manga shading |
<!--
## 🙂 Example
- transform it into Ghibli style
- Source Image
- ![image/jpeg](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FYSqHEgoMLoCWHB9r9rbL7.jpeg%3C%2Fspan%3E)%3C!-- HTML_TAG_END -->
- Target Image
- ![image/jpeg](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FeryeU7hvA7gvkw1134gYU.jpeg%3C%2Fspan%3E)%3C!-- HTML_TAG_END -->
- transform it into 3D Chibi style
- Source Image
- ![image/jpeg](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2F1tuBpVvprYA3LaZl10gcN.jpeg%3C%2Fspan%3E)%3C!-- HTML_TAG_END -->
- Target Image
- ![image/png](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FKAPjcbO4FVvCnPf4Ny3UC.png%3C%2Fspan%3E)%3C!-- HTML_TAG_END -->
- transform it into Oil Painting style
- Source Image
- ![image/jpeg](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FfdrT28mSr5OsxvV04pXZ8.jpeg%3C%2Fspan%3E)%3C!-- HTML_TAG_END -->
- Target Image
- ![image/png](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2F8qCwpJpyDpScGpY8eMXno.png%3C%2Fspan%3E)%3C!-- HTML_TAG_END -->
- transform it into Jojo style
- Source Image
- ![image/jpeg](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2Fhrw-jnm4cDoIOLr5DN0V-.jpeg%3C%2Fspan%3E)%3C!-- HTML_TAG_END -->
- Target Image
- ![image/png](/static-proxy?url=https%3A%2F%2Fcdn-uploads.huggingface.co%2Fproduction%2Fuploads%2F634dffc49b777beec3bc6448%2FO09TlMIMNDcU7HuD-uL3T.png%3C%2Fspan%3E)%3C!-- HTML_TAG_END -->
-->
## ✨ Example Workflow
```mermaid
graph LR
A[Original Image] --> B(Kontext + LoRA)
B --> C{Style Prompt}
C -->|Ghibli| D["<img src='https://huggingface.co/datasets/svjack/Xiang_idol_Kontext_OmniConsistency_lora_Images/resolve/main/ghibli_example.jpg' width='150'/>"]
C -->|3D Chibi| E["<img src='https://huggingface.co/datasets/svjack/Xiang_idol_Kontext_OmniConsistency_lora_Images/resolve/main/chibi_example.jpg' width='150'/>"]
C -->|Oil Painting| F["<img src='https://huggingface.co/datasets/svjack/Xiang_OmniConsistency_Images/resolve/main/oil_example.jpg' width='150'/>"]
C -->|Jojo| G["<img src='https://huggingface.co/datasets/svjack/Premier_Zhou_OmniConsistency_Images/resolve/main/jojo_example.jpg' width='150'/>"]
C -->|Van Gogh| H["<img src='https://huggingface.co/datasets/svjack/Xiang_OmniConsistency_Images/resolve/main/vangogh_example.jpg' width='150'/>"]
```
**Explore more examples**:
- [Xiang Idol Style Transfers](https://huggingface.co/datasets/svjack/Xiang_idol_Kontext_OmniConsistency_lora_Images)
- [Xiang IceCream Style Transfers](https://huggingface.co/datasets/svjack/Xiang_IceCream_Kontext_OmniConsistency_lora_Images)
- [General Examples](https://huggingface.co/datasets/svjack/Xiang_OmniConsistency_Images)
- [Historical Transforms](https://huggingface.co/datasets/svjack/Premier_Zhou_OmniConsistency_Images)
---
## Model Details
- **Base Architecture**: Kontext (12B-parameter rectified flow transformer)
- **Fine-tuning**: LoRA adaptation for multi-style transfer
- **Model File**: [`my_first_flux_kontext_lora_v1_000005000.safetensors`](https://huggingface.co/svjack/Kontext_OmniConsistency_lora/resolve/main/my_first_flux_kontext_lora_v1_000005000.safetensors)