Anonymity - Stylography protection (Running a Local LLM and copy pasting messages) #13

Open
opened 2024-09-17 20:31:55 +02:00 by nihilist · 6 comments
Owner
No description provided.
nihilist added this to the OPSEC Tutorials (paid contributions) project 2024-09-17 20:31:55 +02:00
Author
Owner

Assigned to pippin
price: 40 euros
deadline: 24th September

Assigned to pippin price: 40 euros deadline: 24th September
nihilist added the
Complex
label 2024-09-23 10:30:43 +02:00
Author
Owner

past the deadline, unassigning

past the deadline, unassigning
Author
Owner
image
<img width="1154" alt="image" src="attachments/bee35395-1bf0-49f2-9fce-b8c20ee30c04">
538 KiB
nihilist added the
/!\ On Priority - High Quality Tutorial
label 2024-10-15 13:24:17 +02:00
Author
Owner
see https://github.com/jasonacox/TinyLLM?tab=readme-ov-file#run-a-chatbot might be a good candidate
Author
Owner

to be showcased :
-how to setup locally, in a whonix VM https://github.com/jasonacox/TinyLLM?tab=readme-ov-file#run-a-chatbot or https://github.com/lmstudio-ai (LMSTUDIO AI MAY complain about threads if you only give it 4 vCPUs >> not adapted to a VM setup ???)
--> IT CANNOT BE RAN OUTSIDE OF THE WHONIX VM! need to find a way.

-make it run a TINY model to reduce the cpu usage as much as possible https://lmstudio.ai/model/llama-3.2-1b-instruct ???
-how to use it, from within the whonix VM (and see if the performance sucks or not)

to be showcased : -how to setup locally, in a whonix VM https://github.com/jasonacox/TinyLLM?tab=readme-ov-file#run-a-chatbot or https://github.com/lmstudio-ai (LMSTUDIO AI MAY complain about threads if you only give it 4 vCPUs >> not adapted to a VM setup ???) --> IT CANNOT BE RAN OUTSIDE OF THE WHONIX VM! need to find a way. -make it run a TINY model to reduce the cpu usage as much as possible https://lmstudio.ai/model/llama-3.2-1b-instruct ??? -how to use it, from within the whonix VM (and see if the performance sucks or not)
Author
Owner

assigned to: WonderfulEpitome
price: 50 euros
deadline: 19th November

assigned to: WonderfulEpitome price: 50 euros deadline: 19th November
Sign in to join this conversation.
No Milestone
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: nihilist/blog-contributions#13
No description provided.