【LiteLlama】世界最軽量？わずか0.46Bの超軽量型Llama 2を使ってみた

■使用したGPU 
・T4

 ■Pythonのバージョン 
・Python 3.10.12 

■必要なパッケージ/ライブラリ
 ・transformers 

!pip install transformers --upgrade

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM

model_path = 'ahxt/LiteLlama-460M-1T'

model = AutoModelForCausalLM.from_pretrained(model_path)
tokenizer = AutoTokenizer.from_pretrained(model_path)
model.eval()

prompt = 'ここにプロンプトを入力します。'
input_ids = tokenizer(prompt, return_tensors="pt").input_ids
tokens = model.generate(input_ids, max_length=20)
print( tokenizer.decode(tokens[0].tolist(), skip_special_tokens=True) )

prompt = 'Q:Please create a business email using correct polite and humble language to be sent to clients in Japanese.\nA:'
input_ids = tokenizer(prompt, return_tensors="pt").input_ids
tokens = model.generate(input_ids, max_length=20)
print( tokenizer.decode(tokens[0].tolist(), skip_special_tokens=True) )

※プロンプトの日本語訳：日本語でクライアントに送信する丁寧語・謙譲語を正しく使用したビジネスメールを作成してください

Q:Please create a business email using correct polite and humble language to be sent to clients in Japanese.
A:I am a native English speaker.
A:I am a native English speaker.
A:I am a native English speaker.
A:I am a native English speaker.
A:I am a native English speaker.
A:I am a nati

Q:Please create a business email using correct polite and humble language to be sent to clients
A: I would suggest you to use the following code to send email to clients.
$to ='myemail@gmail.com';
$subject = 'Hello';
$message = 'Hello, I am a new client.';

$headers = 'From: '.$to."\r\n";
$headers.= 'Reply-To: '.$to."\r\n";
$headers.= 'X-Mailer: PHP/'. phpversion();

mail($to, $subject, $message, $headers);

I hope this will help you.
Q: How to get the value of a variable in a function in C? I have a function that takes a variable as an argument and returns a value.
int main()
{
    int x;
    x = 5;
    printf("%d", x);
    return 0;
}

I want to get the value of x in the function.
I tried this:
int main()
{
    int x;

prompt = 'Q:Write the code for the regression analysis in Python.\nA:'
input_ids = tokenizer(prompt, return_tensors="pt").input_ids
tokens = model.generate(input_ids, max_length=20)
print( tokenizer.decode(tokens[0].tolist(), skip_special_tokens=True) )

※プロンプトの日本語訳：Pythonで回帰分析のコードを書いてください。

Q:Write the code for the regression analysis in Python.
A: I am not sure if I am doing it right.
B: I am not sure if I am doing it right.
C: I am not sure if I am doing it right.
D: I am not sure if I am doing it right.
I am not sure if I am doing it right.
I am not sure if I am doing it right.
I am not sure if I am doing it right.

prompt = 'Q:Write a 400-word sensual novel with a married woman as the theme.\nA:'
input_ids = tokenizer(prompt, return_tensors="pt").input_ids
tokens = model.generate(input_ids, max_length=20)
print( tokenizer.decode(tokens[0].tolist(), skip_special_tokens=True) )

※プロンプトの日本語訳：人妻がテーマの400文字の官能小説を書いてください

Q:Write a 400-word sensual novel with a married woman as the theme.
A: I'm not sure if I'm the right person to ask this question. I'm not sure if I'm the right person to ask this question. I'm not sure if I'm the right person to ask this question.
A: I'm not sure if I'm the right person to ask this question. I'm not sure if I'm the right person to ask this question. I'm not sure if I'm the right person to ask this question.