text-generation-webui

zhengjl/text-generation-webui

Public Access

Fork 0

Commit Graph

Select branches

Hide Pull Requests

concatenate-events

dependabot/pip/llama-cpp-python-0.1.32

main

new-qwop

prompt_template_extension

refactor

reformat

reformat2

state_as_function_params

#1004

#1005

#1006

#1006

#1008

#1013

#1015

#1016

#1021

#1021

#1027

#1027

#1028

#1030

#1034

#1034

#1038

#1038

#1042

#1044

#1046

#1046

#1051

#1055

#1060

#1064

#1064

#1065

#110

#113

#12

#123

#135

#143

#149

#16

#163

#169

#17

#175

#189

#192

#195

#198

#201

#204

#206

#207

#210

#211

#219

#224

#235

#24

#255

#258

#259

#260

#263

#266

#27

#275

#294

#295

#296

#30

#304

#305

#306

#307

#309

#312

#325

#337

#342

#344

#345

#348

#358

#363

#366

#377

#38

#389

#393

#402

#407

#414

#43

#433

#437

#442

#447

#454

#455

#460

#471

#477

#478

#489

#495

#500

#504

#515

#518

#521

#526

#529

#530

#538

#546

#547

#549

#551

#553

#556

#565

#568

#57

#570

#572

#585

#587

#587

#596

#601

#602

#603

#607

#607

#615

#616

#618

#619

#627

#627

#628

#633

#650

#652

#654

#66

#664

#67

#672

#673

#678

#68

#686

#691

#691

#694

#711

#715

#717

#719

#720

#720

#723

#724

#725

#725

#730

#731

#732

#740

#743

#744

#746

#747

#751

#751

#757

#76

#760

#763

#767

#770

#771

#772

#784

#785

#798

#803

#812

#814

#815

#820

#823

#826

#833

#838

#842

#859

#862

#863

#877

#878

#881

#883

#90

#903

#904

#906

#906

#915

#917

#926

#938

#940

#948

#950

#954

#970

#970

#976

#976

#977

#986

#990

#990

#997

installers

79d3a524f2 Add a file oobabooga 2023-02-14 15:18:05 -03:00
f6bf74dcd5 Add Silero TTS extension oobabooga 2023-02-14 15:06:06 -03:00
01e5772302 Update README.md oobabooga 2023-02-14 13:06:26 -03:00
d910d435cd Consider the softprompt in the maximum prompt length calculation oobabooga 2023-02-14 12:06:47 -03:00
8b3bb512ef Minor bug fix (soft prompt was being loaded twice) oobabooga 2023-02-13 23:34:04 -03:00
56bbc996a4 Minor CSS change for readability oobabooga 2023-02-13 23:01:14 -03:00
210c918199 Update README.md oobabooga 2023-02-13 21:49:19 -03:00
2fe9d7f372 Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-02-13 18:48:46 -03:00
7739a29524 Some simplifications oobabooga 2023-02-13 18:48:32 -03:00
b7ddcab53a Update README.md oobabooga 2023-02-13 15:52:49 -03:00
3277b751f5 Add softprompt support (for real this time) oobabooga 2023-02-13 15:25:16 -03:00
aa1177ff15 Send last internal reply to input rather than visible oobabooga 2023-02-13 03:29:23 -03:00
61aed97439 Slightly increase a margin oobabooga 2023-02-12 17:38:54 -03:00
2c3abcf57a Add support for rosey/chip/joi instruct models oobabooga 2023-02-12 09:46:34 -03:00
7ef7bba6e6 Add progress bar for model loading oobabooga 2023-02-12 09:36:27 -03:00
939e9d00a2 Update README.md oobabooga 2023-02-12 00:47:03 -03:00
bf9dd8f8ee Add --text-only option to the download script oobabooga 2023-02-12 00:42:56 -03:00
42cc307409 Update README.md oobabooga 2023-02-12 00:34:55 -03:00
66862203fc Only download safetensors if both pytorch and safetensors are present oobabooga 2023-02-12 00:06:22 -03:00
5d3f15b915 Use the CPU if no GPU is detected oobabooga 2023-02-11 23:17:06 -03:00
337290777b Rename example extension to "softprompt" oobabooga 2023-02-11 17:17:10 -03:00
b3c4657c47 Remove commas from preset files oobabooga 2023-02-11 14:54:29 -03:00
144857acfe Update README oobabooga 2023-02-11 14:49:11 -03:00
0dd1409f24 Add penalty_alpha parameter (contrastive search) oobabooga 2023-02-11 14:48:12 -03:00
8aafb55693 1-click installer now also works for AMD GPUs oobabooga 2023-02-11 14:24:47 -03:00
7eed553337 Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-02-11 08:00:29 -03:00
2ed0386d87 Fix replace last reply in --chat mode (for #69) oobabooga 2023-02-11 07:59:54 -03:00
1e97cb9570 Merge pull request #68 from Spencer-Dawson/patch-1 oobabooga 2023-02-11 07:56:30 -03:00
1176d64b13 Update README.md oobabooga 2023-02-11 07:56:12 -03:00
c5324d653b re-added missed README changes Spencer-Dawson 2023-02-11 00:13:06 -07:00
cf89ef1c74 Update README.md oobabooga 2023-02-10 21:46:29 -03:00
8782ac1911 Update README.md oobabooga 2023-02-10 17:10:27 -03:00
7d7cc37560 Add Linux 1-click installer oobabooga 2023-02-10 17:09:53 -03:00
316e07f06a auto-assign gpu memory with --auto-devices alone installers oobabooga 2023-02-10 16:36:06 -03:00
76d3d7ddb3 Reorder the imports here too oobabooga 2023-02-10 15:57:55 -03:00
219366342b Sort imports according to PEP8 (based on #67) oobabooga 2023-02-10 15:40:03 -03:00
96d56d4f3c Turn the example script into a soft prompt script oobabooga 2023-02-10 15:24:26 -03:00
e0b164feab Merge pull request #66 from 81300/bf16 oobabooga 2023-02-09 15:13:17 -03:00
20dbef9623 Extend bfloat16 support 81300 2023-02-09 20:00:03 +02:00
991de5ed40 Update README.md oobabooga 2023-02-09 14:36:47 -03:00
04d3d0aee6 Add 1-click windows installer (for #45) oobabooga 2023-02-09 13:27:30 -03:00
a21620fc59 Update README oobabooga 2023-02-08 01:17:50 -03:00
cadd100405 min_length has to be 0 when streaming is on oobabooga 2023-02-08 00:23:35 -03:00
6be571cff7 Better variable names oobabooga 2023-02-08 00:19:20 -03:00
fc0493d885 Add credits oobabooga 2023-02-08 00:09:41 -03:00
58b07cca81 length_penalty can be negative (apparently) oobabooga 2023-02-07 23:33:02 -03:00
d038963193 Rename a variable (for #59) oobabooga 2023-02-07 23:26:02 -03:00
7e4c25691d Repetition penalty has to be < 5 oobabooga 2023-02-07 23:23:39 -03:00
1c30e1b49a Add even more sliders oobabooga 2023-02-07 23:11:04 -03:00
24dc705eca Add lots of sliders oobabooga 2023-02-07 22:08:21 -03:00
53af062fa5 Update README.md oobabooga 2023-02-05 23:14:25 -03:00
a2519ede90 Merge pull request #57 from martinnj/fix/tokenize-dialogue-regex-backref oobabooga 2023-02-05 14:09:19 -03:00
06a4664805 Fix a regex issue in tokenize_dialogue. Martin J 2023-02-05 07:42:57 +01:00
2fe235738e Reorganize chat buttons oobabooga 2023-02-04 22:53:42 -03:00
2207d44986 Windows doesn't like : in filenames oobabooga 2023-02-04 20:07:39 -03:00
b4fc8dfa8f Add safetensors version oobabooga 2023-02-04 18:58:17 -03:00
65266f3349 Fix loading official colab chat logs oobabooga 2023-02-03 22:43:02 -03:00
54a6a74b7d Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-02-03 20:07:38 -03:00
3dbebe30b1 Remove deepspeed requirement (only works on Linux for now) oobabooga 2023-02-03 20:07:13 -03:00
90bb2caffd Update README.md oobabooga 2023-02-03 19:45:11 -03:00
9215e281ba Add --threads option to the download script oobabooga 2023-02-03 18:57:12 -03:00
03f084f311 Add safetensors support oobabooga 2023-02-03 18:36:32 -03:00
93b0d1b1b8 Update README.md oobabooga 2023-02-03 10:14:52 -03:00
44e8c671f9 Fix API documentation formatting in chat mode oobabooga 2023-02-03 10:00:05 -03:00
03ebfba0fb Bump bitsandbytes version oobabooga 2023-02-03 09:29:31 -03:00
6212b41930 Update README oobabooga 2023-02-03 09:13:14 -03:00
a28f0d8bd7 Show it/s in the same units with or without streaming oobabooga 2023-02-03 09:11:11 -03:00
4e4cd67223 Save chat history with name/date in filename oobabooga 2023-02-03 09:02:35 -03:00
3af3ffeb90 Make --help output more readable oobabooga 2023-02-02 23:36:28 -03:00
638495b633 Simplify generate() function oobabooga 2023-02-02 13:47:08 -03:00
3f05cf5ddd Simplify encode() function oobabooga 2023-02-02 13:31:32 -03:00
afc2b0f4c8 Remove .gitignore oobabooga 2023-02-02 12:42:49 -03:00
224be31a74 Use main bs4 package oobabooga 2023-02-02 12:20:58 -03:00
cecaebc291 Add bs4 requirement (fixes #47) oobabooga 2023-02-02 12:18:32 -03:00
0c2eb444e6 Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-02-02 12:17:02 -03:00
2583bc5840 Simplify deepspeed implementation (#40) oobabooga 2023-02-02 12:15:44 -03:00
7f4315b120 Mention 8bit fix for Windows users oobabooga 2023-02-02 11:00:57 -03:00
d6b2d68527 Remove redundant requirements oobabooga 2023-02-02 10:40:09 -03:00
f38c9bf428 Fix deepspeed (oops) oobabooga 2023-02-02 10:39:37 -03:00
90f1067598 Move deepspeed parameters to another file oobabooga 2023-02-02 10:25:09 -03:00
1a658b41aa Merge pull request #43 from 81300/ds oobabooga 2023-02-02 10:03:19 -03:00
39461bd796 Delete .gitignore oobabooga 2023-02-02 10:01:56 -03:00
248ec4fa21 Merge branch 'oobabooga:main' into ds 81300 2023-02-01 20:50:51 +02:00
a6f4760772 Add arg for bfloat16 81300 2023-02-01 20:22:07 +02:00
c515282f5c no_split_module_classes not needed 81300 2023-02-01 19:47:26 +02:00
0a0d289537 Fix issue with generating on multiple GPUs 81300 2023-02-01 19:02:07 +02:00
a97afa6965 Add DeepSpeed ZeRO-3 integration 81300 2023-02-01 14:57:27 +02:00
6b13816c47 Change default --disk behavior oobabooga 2023-02-01 10:43:28 -03:00
119be56390 Add back low_cpu_mem_usage=True oobabooga 2023-02-01 10:01:44 -03:00
d4a0b377ab Allow standalone --cpu-memory oobabooga 2023-01-31 21:23:16 -03:00
efb0ab502e New preset oobabooga 2023-01-31 21:03:25 -03:00
8ef89df746 Try to leave at least 1GiB free to prevent oom errors oobabooga 2023-01-31 20:47:05 -03:00
bb77f20a6c Don't use low_cpu_mem_usage and device_map together oobabooga 2023-01-31 13:24:05 -03:00
824329749d Merge pull request #38 from Silver267/patch-2 oobabooga 2023-01-31 08:14:50 -03:00
001ecf95b2 Update server.py oobabooga 2023-01-31 08:14:16 -03:00
a85bb5e9a2 Fix an error Silver267 2023-01-31 01:34:10 -05:00
5b0bbfa6e8 Clean up oobabooga 2023-01-30 14:17:12 -03:00
7aa3d6583e Update README.md oobabooga 2023-01-30 09:45:31 -03:00
239f96a9c5 Add extensions guide oobabooga 2023-01-30 09:44:57 -03:00
dfbca86533 Add **bold** support in chat mode oobabooga 2023-01-30 08:36:58 -03:00

... 9 10 11 12 13 ...