haraldwolff
/
whisper.cpp
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
whisper.cpp/examples
History
Georgi Gerganov 8de452c18b
Improve decoding (#291) 
* whisper : prepare infra for new decoding strategies

* whisper : apply logit filters and compute logprobs

* whisper : add whisper_get_logits()

* whisper : separate self and cross attention memory

Initial step needed for supporting parallel decoders

* whisper : move probs_id buffer to whisper_context

* whisper : refactor kv cache into separate struct

* whisper : move self-attention kv cache to whisper_decoder

* whisper : wip decoding parameters + strategies

* whisper : wip decoding parameters + strategies (part 2)

* whisper : wip decoding parameters + strategies (part 3)

* whisper : wip decoding parameters + strategies (part 4)

* whisper : fix prompt_past update to not include prompt_init

* whisper : temperature + best_of support

* whisper : support for compression_ration_threshold

We actually use entropy, but it is similar

* command : fix example to use logits instead of obsolete probs

* whisper : handle empty sequence ranking

* whisper : add WHISPER_DEBUG + diagnostic prints + new main args

* whisper : minor fixes

* whisper : add beam-search support

* whisper : bug fix when there no previous context

* whisper : add comments

* stream : disable temperature fallback

For real-time processing, we always want a single decoder running at T=0

* whisper.swiftui : update example - fix paths + add empty folders
 		2023-01-15 11:29:57 +02:00
..
bench whisper : add loader class to allow loading from buffer and others (#353) 2023-01-08 13:03:33 +02:00
bench.wasm whisper : add loader class to allow loading from buffer and others (#353) 2023-01-08 13:03:33 +02:00
command Improve decoding (#291) 2023-01-15 11:29:57 +02:00
command.wasm whisper : add loader class to allow loading from buffer and others (#353) 2023-01-08 13:03:33 +02:00
main Improve decoding (#291) 2023-01-15 11:29:57 +02:00
stream Improve decoding (#291) 2023-01-15 11:29:57 +02:00
stream.wasm Improve decoding (#291) 2023-01-15 11:29:57 +02:00
talk whisper : add loader class to allow loading from buffer and others (#353) 2023-01-08 13:03:33 +02:00
talk.wasm whisper : add loader class to allow loading from buffer and others (#353) 2023-01-08 13:03:33 +02:00
whisper.android whisper : add loader class to allow loading from buffer and others (#353) 2023-01-08 13:03:33 +02:00
whisper.nvim Update README.md 2022-11-04 22:26:08 +02:00
whisper.objc whisper : add loader class to allow loading from buffer and others (#353) 2023-01-08 13:03:33 +02:00
whisper.swiftui Improve decoding (#291) 2023-01-15 11:29:57 +02:00
whisper.wasm whisper : add loader class to allow loading from buffer and others (#353) 2023-01-08 13:03:33 +02:00
CMakeLists.txt bench.wasm : same as "bench" but runs in the browser (#89) 2022-12-11 11:09:10 +02:00
dr_wav.h refactoring : move main + stream in examples + other stuff 2022-10-25 20:53:48 +03:00
generate-karaoke.sh minor : add comment for using "generate_karaoke.sh" 2022-11-26 10:22:42 +02:00
helpers.js stream.wasm : add web-based real-time transcription (#112) 2022-11-25 23:57:46 +02:00
livestream.sh twitch.sh : various fixes and polishing 2022-12-08 19:20:04 +02:00
twitch.sh twitch.sh : various fixes and polishing 2022-12-08 19:20:04 +02:00
yt-wsp.sh yt-wsp.sh : improve usage instructions 2022-12-07 22:12:08 +02:00