LeroyDyer commited on
Commit
74b2804
·
verified ·
1 Parent(s): 263d046

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md CHANGED
@@ -29,6 +29,41 @@ Clone APP ! and run LOCAL !
29
 
30
  Use LMSTUDIO !
31
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
  change the base model to your model !
33
  (QWEN 30b )
34
 
 
29
 
30
  Use LMSTUDIO !
31
 
32
+
33
+ ```python
34
+ #############################################################
35
+ BASE_URL="http://localhost:1234/v1"
36
+ BASE_API_KEY="not-needed"
37
+ BASE_CLIENT = AsyncOpenAI(
38
+ base_url=BASE_URL,
39
+ api_key=BASE_API_KEY
40
+ ) # Global state for client
41
+ BASEMODEL_ID = "leroydyer/qwen/qwen3-0.6b-q4_k_m.gguf" # Global state for selected model ID
42
+ CLIENT =OpenAI(
43
+ base_url=BASE_URL,
44
+ api_key=BASE_API_KEY
45
+ ) # Global state for client
46
+
47
+ ```
48
+
49
+ change here at the top of the file !
50
+
51
+
52
+ Also :
53
+ this has over 100 agents !
54
+ Also :
55
+ there is a model inside , ie my client ! called LLMAGent : This Class is a client using open ai , it has interneal message queue so all multi querys can go and it will put the responses on the queue to retriev !
56
+ this enables for more than async !!
57
+
58
+ Also :
59
+
60
+ i have a AgentFunciton !
61
+
62
+ this is a agent chaining subagent model:
63
+
64
+ so each model has a submodel !
65
+
66
+
67
  change the base model to your model !
68
  (QWEN 30b )
69