Skip to main content

Posts

Showing posts with the label text generation without prompt

huggingface transformers library part 3: Natural language generation

 Introduction: The part of machine learning which deals with language modeling and textual data; can be divided into three broad parts. These three parts are: (1) Natural language processing (NLP) : this is processing of unstructured text data into structured, analyzed and often quantized  data form.  (2) Natural language understanding or inferencing ( NLU/ NLI): this refers to working on algorithms and models which understand written languages rather than just statistically analyzing it. (3) Natural language generation (NLG): this refers to building models/frameworks which generate contents which mimic the quality of actual human writings. For years, NLP, NLU and NLG have progressed, with much variance and overlap in between them. With the introduction of RNN, LSTM, CNN etc, NLG systems have shown much better progress than previous times; just like the counterparts. In this article, we will test out the performance of NLG tasks using the transformers library; namely we...