Thanks to visit codestin.com
Credit goes to Github.com

Skip to content

Gw/sd-turbo #41

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
gwenzek wants to merge 28 commits into
base: master
Choose a base branch
from
Draft

Gw/sd-turbo #41

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
48a1b65
download sd-turbo weights
gwenzek Oct 3, 2024
1853e01
sdxl: conv2d + groupNorm
gwenzek Oct 3, 2024
fc68537
add resnet
gwenzek Oct 3, 2024
9ed48f5
zml: normalize & co should take an axis.
gwenzek Oct 3, 2024
20db38c
normalizeVariance should take an axis
gwenzek Oct 3, 2024
5211160
add sdxl/transfomer.zig (from llama.zig)
gwenzek Oct 3, 2024
d7ec453
ClipMlp
gwenzek Oct 3, 2024
7c3a046
remove KvCache
gwenzek Oct 3, 2024
20102eb
baby pandas are cute
gwenzek Oct 3, 2024
1fc06cc
minimal ClipTransformer
gwenzek Oct 3, 2024
efabedd
python ♡ typos
gwenzek Oct 4, 2024
d60e27f
loadSdTurboTokenizer
gwenzek Oct 4, 2024
82b09c5
zml.tokenizer: add comments
gwenzek Oct 4, 2024
29c3073
load CrossAttnDownBlock2D
gwenzek Oct 4, 2024
850c75e
implement Geglu
gwenzek Oct 4, 2024
2ffd04a
Transformer2DModel
gwenzek Oct 4, 2024
f3772e4
use tuples in Unet struct
gwenzek Oct 6, 2024
48f7723
CrossAttnDownBlock2D
gwenzek Oct 7, 2024
7169caf
UNetMidBlock2DCrossAttn
gwenzek Oct 7, 2024
db517ec
UpBlocks
gwenzek Oct 7, 2024
6f4eb7b
keep more structure when collecting pytorch input/output
gwenzek Oct 7, 2024
524c990
aio.zig: support arrays in struct
gwenzek Oct 7, 2024
59ecb07
fix downscaled_images type
gwenzek Oct 7, 2024
893c793
extract layerNorm and groupNorm into functions
gwenzek Oct 9, 2024
cac766e
vae.decoder.mid_block compile
gwenzek Oct 18, 2024
f3301b3
groupNorm
gwenzek Oct 21, 2024
a67e9a1
zml/testing: add better error messages for non-contiguous buffers
gwenzek Oct 21, 2024
cd52724
make sdxl activations contiguous
gwenzek Oct 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 37 additions & 0 deletions examples/MODULE.bazel
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -185,3 +185,40 @@ copy_file(
model = "openlm-research/open_llama_3b",
)
use_repo(huggingface, "OpenLM-Research-OpenLLaMA-3B")


huggingface.model(
name = "StabilityAI-sd-turbo",
build_file_content = """\
package(default_visibility = ["//visibility:public"])

filegroup(
name = "vae",
srcs = ["vae/diffusion_pytorch_model.fp16.safetensors"],
)

filegroup(
name = "prompt_encoder",
srcs = ["text_encoder/model.fp16.safetensors",],
)

filegroup(
name = "vocab",
srcs = ["tokenizer/vocab.json"],
)

filegroup(
name = "unet",
srcs = ["unet/diffusion_pytorch_model.fp16.safetensors"],
)
""",
commit = "0096a99066b73650354282eeef18114cf0dab75c",
model = "stabilityai/sd-turbo",
includes = [
"vae/diffusion_pytorch_model.fp16.safetensors",
"text_encoder/model.fp16.safetensors",
"tokenizer/vocab.json",
"unet/diffusion_pytorch_model.fp16.safetensors",
],
)
use_repo(huggingface, "StabilityAI-sd-turbo")
36 changes: 36 additions & 0 deletions examples/sdxl/BUILD.bazel
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
load("@bazel_skylib//rules:native_binary.bzl", "native_binary")
load("@zml//bazel:zig.bzl", "zig_cc_binary")

zig_cc_binary(
name = "sdxl_bin",
main = "main.zig",
deps = [
"//third_party/tigerbeetle:flags",
"@zml//async",
"@zml//zml",
],
srcs = ["transformer.zig"],
)

native_binary(
name = "sdxl",
src = ":sdxl_bin",
args = [
# vae model
"$(location @StabilityAI-sd-turbo//:vae)",
# lightning model
"$(location @StabilityAI-sd-turbo//:unet)",
# prompt encoder, and vocab
"$(location @StabilityAI-sd-turbo//:prompt_encoder)",
"$(location @StabilityAI-sd-turbo//:vocab)",
"'A cinematic shot of a baby racoon wearing an intricate italian priest robe.'",
"$(location :sd-turbo.activations.pt)",
],
data = [
"@StabilityAI-sd-turbo//:vae",
"@StabilityAI-sd-turbo//:unet",
"@StabilityAI-sd-turbo//:prompt_encoder",
"@StabilityAI-sd-turbo//:vocab",
":sd-turbo.activations.pt",
],
)
Loading