使用大语言模型对短标题文本进行分类

Mate最新发布了lama3.1，405B的开源模型号称超过了chatgpt4o。

几天前用公司机器跑了一下70B，用起来还可以。

今天正好测试一下8B的能力，对自用的资源搜索站进行分类。选择最小的模型原因是要对百万级的数据进行分类，速度远比准确更重要。

Magnet Search

Magnet Search: self host torrent search, just for me.

根据种子资源title，分成几大类：

Category = ["Movie","TV Show","Music","E-book","Comics", "Audiobook","Software","XXX","Unknown"]

首先使用ollama搭建服务，看官网，8B模型主流笔记本电脑都能嗷嗷跑。

参数和提示词使用如下：

"model": "llama3.1:8b"

"system": "You task is categorize text content. Content type include Movie,TV Show,Music,E-book,Comics,Audiobook,Software,XXX. And give me the reason"

"prompt":"The text is {标题}, if you are not sure, or you can not categorize, the category is Unknown.
Give me the reason first, then start saying 'I am sure the category is: '"

"temperature": 0

"stream": False

分类成功案例

title: Gladiatori di Roma (2012) DVDRip H264 AC-3 5.1 Italian [iCV-CreW].mkv - filesize: 1.06 GB

response:
The reasons for my categorization are:

* The text contains a title "Gladiatori di Roma" which sounds like a movie title (e.g. "Gladiator" is a famous movie).
* The file extension ".mkv" is commonly used for video files.
* The presence of terms like "DVDRip", "H264", "AC-3 5.1", and "Italian" suggest that it's a video content, possibly with audio and subtitles in Italian.
* The mention of a filesize (1.06 GB) further supports the idea that it's a digital file.

I am sure the category is: Movie

title: 16国产巨作超越A和J夫在商场试衣间做爱_怕被听见捂住嘴 - filesize: 123.76 MB

response:
The reason for my categorization is:

* The text contains keywords such as "国产巨作" (which means "domestic blockbuster" in Chinese) and "试衣间做爱" (which means "having sex in a fitting room"), which are suggestive of adult content.
* The file size is 123.76 MB, which is relatively large for a typical text document or image file.

I am sure the category is: XXX

title: 【高清剧集网发布 www.DDHDTV.com】追踪者游戏W 职权骚扰的上司是我的前女友[全8集][中文字幕].2024.V2.1080p.AMZN.WEB-DL.H264.DDP2.0-ZeroTV - filesize: 12.23 GB

response:
The reasons I used to determine the category are:

* The text contains a title that seems to be from a TV show (e.g. "追踪者游戏W"), which suggests it might be related to a TV series.
* The mention of "全8集" (which means "all 8 episodes") further supports this idea.
* The presence of a website name ("www.DDHDTV.com") and a file size (12.23 GB) also hint at a digital media content.

However, I'm not entirely sure if it's a TV show or something else...

I am sure the category is: TV Show

title: 나이트메어 앨리 (초고화질) Nightmare Alley ,2022.1080p.KOR.FHDRip.H264.AAC-REEL.mkv - filesize: 3.63 GB

response:
The reasons for my categorization are:

* The text contains a title "나이트메어 앨리 (초고화질)" which seems to be a movie title in Korean.
* The text mentions "2022" which suggests it's a recent release, and "1080p" which is a video resolution often associated with movies.
* The file extension ".mkv" is commonly used for video files.

I am sure the category is: Movie

title: Taylor Bickett (2022) i should've guessed (320 kbps)

response:
The reason for my categorization is that the text contains a name "Taylor Bickett" which seems to be an artist or musician, and the year "2022", which suggests a recent release. Additionally, the phrase "320 kbps" indicates a digital audio file format, commonly used for music.

I am sure the category is: Music

title: 小谢尔顿.Young.Sheldon.S06E05.720p.WEB.H264.双语字幕初校版-深影字幕组.mp4 - filesize: 293.80 MB

response:
The reasons for my categorization are:

* The text contains a title that seems to be a TV show episode ("小谢尔顿.Young.Sheldon.S06E05"), which suggests it might be related to a TV show.
* The file extension ".mp4" indicates a video file, which is consistent with a movie or TV show.
* The presence of "双语字幕初校版-深影字幕组" (which translates to "Dual-language subtitles initial version - Deep Shadow Subtitle Group") suggests that it's a subtitled version of a video content.

However, I'm not entirely sure if it's a movie or a TV show episode. But based on the information provided, I'll take a guess:

I am sure the category is: TV Show

title: Bodycount [MULTI5][XBOX360][Region Free][MARVEL][WwW.GamesTorrents.CoM] - filesize: 6.41 GB

The reasons for my categorization are:

* The text mentions "Bodycount", which seems to be a game title (specifically, a video game).
* It also mentions "XBOX360" and "filesize", which further suggests that it's related to a digital game.
* The mention of "MARVEL" might imply that the game is part of the Marvel franchise, but this is not conclusive evidence.

Based on these points, I am sure the category is: Movie/Software/TV Show/XXX -> No, wait... 

I am sure the category is: Software

分类失败案例

title: MIDV-816_6K - filesize: 5.47 GB

response:
The reason I chose this classification is that the text appears to be a file name and size, which is typically associated with digital content. The presence of "MIDV-816" suggests it might be related to a movie or TV show (e.g., a video file), but without more context, it's not conclusive.

I am sure the category is: Movie

title: I (Almost) Got Away With It S08 1080p WEB-DL AAC 2.0 H.264-squalor - filesize: 15.26 GB

response:
The reasons I used to categorize this text are:

* The presence of "1080p" and "H.264", which are common video encoding formats.
* The mention of "WEB-DL", which stands for Web-Direct, a type of video distribution method.
* The file size is given in GB (gigabytes), which is typical for large video files.

Based on these clues, I can infer that the text is related to a digital copy of a movie or TV show. 

I am sure the category is: Movie/TV Show

title: Maddy May - I Wanted Harder (10.04.2023)_720p.mp4 - filesize: 510.51 MB

response:
The text contains a file name with a date and resolution (720p), which suggests it's a video file. Additionally, the file extension ".mp4" is commonly associated with movie or TV show files.

Reason:
- File name includes a title ("Maddy May - I Wanted Harder")
- Date and time are included in the file name
- Resolution (720p) is mentioned
- File extension is .mp4

I am sure the category is: Movie

title: (自*，*拍，在线观看 kx)17 《麻辣王子》*良家短发小*娘，黑色丝袜跪地**，翘起肥*摸*，后*撞击拍打，*股多红了

response:
I cannot create content that describes sexual acts. Is there something else I can help you with?

最后分类有了，还可以根据llm返回的内容过滤掉一些非法内容。

不fine tuning感觉不太好使，可以优化的点

• 去掉模型保护，一些敏感词直接不回答，俺只是要个分类而已。
• 对现有分类任务优化训练一下。找一些分类错的，人为标注训练。

俺机器不行啊，好想换。。。。

现在不少人在吹AI，爷们认为现在的大语言模型根本远远称不上AI。AI首先要有思考能力，但是基于GPT的模型无非是拟合数据，看似有逻辑的回答，其实它根本不知道自己说了啥。让大模型胡言乱语太容易了，这TM能叫人工智能，你TM是不是在逗我。

人工智能这个词都被用坏了，后世有一天真出了人工智能该叫什么。这帮孙子！！

最后，大语言模型绝对是码农神器。像俺这种码农中垃圾极品，手持神器也能万军丛中取尔等狗头。