Skip to main content

RAG based hate speech detector

Project description

๐Ÿ›ก๏ธ Khater: Advanced Content Moderation (RAG-based) Khater๋Š” ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)๊ณผ ๊ฒ€์ƒ‰ ์ฆ๊ฐ• ์ƒ์„ฑ(RAG) ๊ธฐ์ˆ ์„ ๊ฒฐํ•ฉํ•˜์—ฌ, ๊ธฐ์กด์˜ ๋‹จ์ˆœ ํ‚ค์›Œ๋“œ ๋งค์นญ ์‹œ์Šคํ…œ์ด ํƒ์ง€ํ•˜์ง€ ๋ชปํ•˜๋Š” ์ง€๋Šฅ์  ์šฐํšŒ ๊ณต๊ฒฉ(Adversarial Text) ๋ฐ ๋ฌธ๋งฅ์  ๋ชจ์š•์„ ์‹๋ณ„ํ•˜๋Š” ์ฐจ์„ธ๋Œ€ ์ฝ˜ํ…์ธ  ๋ชจ๋”๋ ˆ์ด์…˜ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค.

โœจ ํ•ต์‹ฌ ๊ธฐ์ˆ  (Key Features) ์ง€๋Šฅ์  ์šฐํšŒ ํ…์ŠคํŠธ(Adversarial Text) ๋ถ„์„: ์š•์„ค ์‚ฌ์ด์— ์ˆซ์ž, ํŠน์ˆ˜๋ฌธ์ž, ๊ณต๋ฐฑ ๋“ฑ์„ ์‚ฝ์ž…ํ•˜์—ฌ ํ•„ํ„ฐ๋ง ์‹œ์Šคํ…œ์„ ๋ฌด๋ ฅํ™”ํ•˜๋ ค๋Š” ๋ณ€์น™์  ์‹œ๋„๋ฅผ ๋ฌธ๋งฅ์ ์œผ๋กœ ์žฌ๊ตฌ์„ฑํ•˜์—ฌ ํƒ์ง€ํ•ฉ๋‹ˆ๋‹ค.

๋ฌธ๋งฅ ๊ธฐ๋ฐ˜ ๋ชจ์š•(Contextual Insult) ์‹๋ณ„: ๊ฒ‰์œผ๋กœ๋Š” ์ •์ค‘ํ•œ ๊ฒฝ์–ด์ฒด๋ฅผ ์‚ฌ์šฉํ•˜๋‚˜ ๋‚ด๋ถ€์ ์œผ๋กœ๋Š” ๋น„ํ•˜์™€ ๋ฉธ์‹œ์˜ ์˜๋„๋ฅผ ๋‹ด์€ '์ง€๋Šฅ์  ๋น„๊ผฌ๊ธฐ' ๋ฐ 'ํ˜•์šฉ์‚ฌํ™”๋œ ๋ชจ์š•'์„ ํŒ๋ณ„ํ•ฉ๋‹ˆ๋‹ค.

๋„๋ฉ”์ธ ํŠนํ™” ๋™์  ํ•„ํ„ฐ๋ง: ์‚ฌ์šฉ์ž ์ธํ„ฐํŽ˜์ด์Šค(UI)๋ฅผ ํ†ตํ•ด ํŠน์ • ์‚ฐ์—…๊ตฐ(์˜ˆ: ๊ฐ€์ƒ์ž์‚ฐ, ๊ฒŒ์ž„ ๋“ฑ)์˜ ๊ณ ์œ  ์šฉ์–ด๋ฅผ ์‹ค์‹œ๊ฐ„ ์ œ์™ธ ๋‹จ์–ด๋กœ ์„ค์ •ํ•˜์—ฌ ์˜คํƒ์ง€(False Positive)๋ฅผ ์ตœ์†Œํ™”ํ•ฉ๋‹ˆ๋‹ค.

RAG ๊ธฐ๋ฐ˜ ๊ทผ๊ฑฐ ์ถ”๋ก : ํŒ์ • ๊ฒฐ๊ณผ์— ๋Œ€ํ•ด ๋‚ด๋ถ€ ์ง€์‹ ๋ฒ ์ด์Šค(Knowledge Base)๋ฅผ ๊ทผ๊ฑฐ๋กœ ํ•œ ์ƒ์„ธ ๋ถ„์„ ์‚ฌ์œ ๋ฅผ ์ œ๊ณตํ•˜์—ฌ ํŒ์ •์˜ ํˆฌ๋ช…์„ฑ์„ ํ™•๋ณดํ•ฉ๋‹ˆ๋‹ค.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

khater-0.1.1.tar.gz (3.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

khater-0.1.1-py3-none-any.whl (3.8 kB view details)

Uploaded Python 3

File details

Details for the file khater-0.1.1.tar.gz.

File metadata

  • Download URL: khater-0.1.1.tar.gz
  • Upload date:
  • Size: 3.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for khater-0.1.1.tar.gz
Algorithm Hash digest
SHA256 0e82cde933bca4e06118c40f67c46b778ee11027d292fa41746fd43ca888b12f
MD5 c5d56fe02b3e0e3dccc0b942bd88aa3c
BLAKE2b-256 12d7cf73318b1daa7d1d36ff3becd6d85125892eed0c692b20a29c7cc021886f

See more details on using hashes here.

File details

Details for the file khater-0.1.1-py3-none-any.whl.

File metadata

  • Download URL: khater-0.1.1-py3-none-any.whl
  • Upload date:
  • Size: 3.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for khater-0.1.1-py3-none-any.whl
Algorithm Hash digest
SHA256 1c9f96ad83f296300b63c870f2a455f4ea7a9977317c0f6733f3dca8629e40da
MD5 0ed5990ceb05b611ce3ab3dc283bdc97
BLAKE2b-256 455181be31b002acb2334180206c77d0e584ea7dedba07c56e1ede907d1cea64

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page