ZHAO Tianyu - homepage
My cats These are my cats.

ZHAO Tianyu 趙天雨

github google scholar x

E-mail: zhaoty.ting[at]gmail.com

Updated on 2024/05/11

I am a research engineer working on language models at Sakana AI.

Prior to Sakana AI, I developed multiple Japanese LLMs at rinna as a researcher.


Work Experience

Research Engineer @ Sakana AI 2024.05 - present
| Language Model

Researcher @ rinna Co., Ltd. 2020.10 - 2024.04
| Alignment, Dialogue, and LLM

Research SDE Intern @ Microsoft Development, rinna Team 2019.10 - 2019.12
| Pre-trained models for Japanese dialogues

Education Experience

Ph.D. @ Kyoto University 2017.10 - 2020.9
| Intelligence Science and Technology
| Supervisor: Tatsuya Kawahara

M.Eng. @ Kyoto University 2015.10 - 2017.9
| Intelligence Science and Technology
| Supervisor: Tatsuya Kawahara

B.Sc. @ Peking University 2011.9 - 2015.7
| Computer Science and Technology
| Supervisor: Yunfang Wu


Selected Publications

Release of pre-trained models for the Japanese language
| Kei Sawada, TyZ, Makoto Shing, Kentaro Mitsui, Akio Kaga, Yukiya Hono, Toshiaki Wakatsuki, and Koh Mitsuda
| arxiv Regular paper at LREC-COLING 2024

Multi-referenced training for dialogue response generation
| TyZ and Tatsuya Kawahara
| PDF code Long paper at SIGDIAL 2021

Designing precise and robust dialogue response evaluators
| TyZ, Divesh Lala, and Tatsuya Kawahara
| PDF code Short paper at ACL 2020

Joint dialog act segmentation and recognition in human conversations using attention to dialog context
| TyZ and Tatsuya Kawahara
| Link code Journal paper at Elsevier CSL 2019

Talks

Nekomata: State-of-the-Art Japanese LLM based on Qwen 2024/01/30
| AI Forward: Alibaba Cloud AI & Big Data Summit 2024 @ Singapore
| Link

日本語LLMの最先端 2023/06/29
| Weights and Biases Tokyo Meetup #5 @ Tokyo
| Link

小冰如何利用FasterTransformer 实现大规模语言模型的产品级部署 2022/12/09
| CNCC 2022 @ Online
| Link

Conversational AI that Learns from the Unverbalized 2021/05/20
| Microsoft Azure AI Days 2021 @ Online

Academic Activities

Reviewer: ACL 2018/2020/2021/2023, ACL ARR, COLING 2020, COLM 2024, EMNLP 2020/2021/2023, IJCNLP 2017/2021, NAACL 2021