20 lines
2.5 KiB
Plaintext
20 lines
2.5 KiB
Plaintext
|
<EFBFBD>
|
|||
|
|
<00><><EFBFBD>i<EFBFBD> <00> <00>h <00> S SK r S SKrS SKrS SKJr \ R
|
|||
|
|
" SS5 r\ R
|
|||
|
|
" SS5 r\R S5 ( a \SS rO\R S 5 ( a \SS
|
|||
|
|
r\\ R S ' \
|
|||
|
|
" S \ 35 \
|
|||
|
|
" S
\ 35 \R " \S9r S\
S\\
S4 4S jrg)<12> N)<01>AsyncGenerator<6F> OLLAMA_MODELz gpt-oss:120b<30>OLLAMA_BASE_URLzhttp://192.168.0.120:11434z/v1/<2F><><EFBFBD><EFBFBD><EFBFBD>z/v1<76><31><EFBFBD><EFBFBD><EFBFBD><EFBFBD> OLLAMA_HOSTz[LLM] Ollama host: z
[LLM] Model: )<01>host<73>prompt<70>returnc <00>| # <00> [ S[ U 5 35 [ S5 [ R [ SU S./SSSS.S 9I S h v<01>N n[ S
|
|||
|
|
5 S nU S h v<01>N nUS ( d M US S
( d M$ US S
nUS-
n[ SU SU 35 [
|
|||
|
|
R " S
U05 7v <00> M_ Nr N\
|
|||
|
|
[ SU 35 g ! [ a^ nS[ U5 3n[ SU 35 S S K nUR 5 [
|
|||
|
|
R " S[ U5 05 7v <00> S nAg S nAff = f7f)Nz-[LLM] Calling Ollama API with prompt length: z [LLM] Awaiting client.chat...<2E>user)<02>role<6C>contentT<74><54> g<><67><EFBFBD><EFBFBD><EFBFBD><EFBFBD><EFBFBD>?)<02> num_predict<63> temperature)<04>model<65>messages<65>stream<61>optionsz.[LLM] Got stream object, starting iteration...r <00>messager <00> z [LLM] Chunk z: z%[LLM] Stream complete, total chunks: zError: z
[LLM] Error: <20>error) <0B>print<6E>len<65>client<6E>chatr <00>json<6F>dumps<70> Exception<6F>str<74> traceback<63> print_exc)r
|
|||
|
|
r <00> chunk_count<6E>chunkr <00>e<> error_msgr" s <20>+/Users/allenyuan/llm-in-text/backend/llm.py<70>
stream_openair) sG <00> <00> <00> <09> 9<>#<23>f<EFBFBD>+<2B> <1D>
|
|||
|
|
G<EFBFBD>H<>,<2C>
<0A>-<2D>/<2F> <1D>{<7B>{<7B> <1E> %<25>&<26>9<>:<3A><17> "<22> "<22><0E> #<23>
|
|||
|
|
<EFBFBD>
|
|||
|
|
<EFBFBD><06> <0E>><3E>@<40><17> <0B>!<21> 7<>%<25><14>Y<EFBFBD> <1F> <1F>E<EFBFBD>)<29>$4<>Y<EFBFBD>$?<3F>$?<3F> <1F> <09>*<2A>9<EFBFBD>5<><07><1B>q<EFBFBD> <20> <0B><15> <0C>[<5B>M<EFBFBD><12>G<EFBFBD>9<EFBFBD>=<3D>><3E><1A>j<EFBFBD>j<EFBFBD>)<29>W<EFBFBD>!5<>6<>6<>#
|
|||
|
|
<EFBFBD> 7<>6<EFBFBD> <0E>5<>k<EFBFBD>]<5D>C<>D<><44> <14> ,<2C> <1D>c<EFBFBD>!<21>f<EFBFBD>X<EFBFBD>&<26> <09>
<0A>
<0A>i<EFBFBD>[<5B>)<29>*<2A><18><11><1B><1B> <1D><12>j<EFBFBD>j<EFBFBD>'<27>3<EFBFBD>q<EFBFBD>6<EFBFBD>*<2A>+<2B>+<2B>+<2B><> ,<2C>sk <00>D<<01>/C <00>
|
|||
|
|
B=<04> C <00> C<02>"B?<06>#C<02>& C <00>3 C <00><C <00>?C<02>C <00>D<<01>
|
|||
|
|
D9<03>AD4<03>/D<<01>4D9<03>9D<)<0F>osr <00>ollama<6D>typingr <00>getenvr r <00>endswith<74>environr <00> AsyncClientr r! r) <00> <00> r( <00><module>r3 s<> <00><01> <09> <0B>
<0A> !<21><11>y<EFBFBD>y<EFBFBD> <1E> <1E>8<> <0C><10>i<EFBFBD>i<EFBFBD>)<29>+G<>H<> <0B> <0F><17><17><06> <1F> <1F> <1D>c<EFBFBD>r<EFBFBD>"<22>K<EFBFBD><10><19><19>%<25> <20> <20> <1D>c<EFBFBD>r<EFBFBD>"<22>K<EFBFBD> '<27><02>
|
|||
|
|
<EFBFBD>
|
|||
|
|
<EFBFBD>=<3D> <19> <05><1B>K<EFBFBD>=<3D>)<29> *<2A> <05>
<0A>l<EFBFBD>^<5E>$<24> %<25> <0F> <1B> <1B><1B> -<2D><06> ,<2C><03> ,<2C><0E>s<EFBFBD>D<EFBFBD>y<EFBFBD>(A<> ,r2
|