《深度自然语言处理》课程教学课件（Natural language processing with deep learning）03 Fundamental Tasks of NLP

西安交通大学Natural languageprocessingwith deep learningXIANHAOTONGUNIVERSITYFundamental Tasks of NLP交通大学Chen Licli@xjtu.edu.cn2023

Chen Li cli@xjtu.edu.cn 2023 Fundamental Tasks of NLP Natural language processing with deep learning

Outline> Taxonomy> Part-of-speech> Pasring

Ø Taxonomy Ø Part-of-speech Ø Pasring Outline

OutlineTaxonomy> Part-of-speech> Pasring

Ø Taxonomy Ø Part-of-speech Ø Pasring Outline

Taxonomy对自然语言进行词汇层面的分析，是NLP基础性工作分调（WordSegmentation/Tokenization）新词发现（NewWordsIdentification）词法分析（LexicalAnalysis）形态分析（MorphologicalAnalysis）词性标注（Part-of-speechTagging）拼写校正（SpellingCorrection）对自然语言进行句子层面的分析，包括包法分析和其他包子级别的分析任务组块分析（Chunking）超级标签标注（SuperTagging）成分旬法分析（ConstituencyParsing）句子分析（SentenceAnalysis）依存句法分析（DependencyParsing）语言模型（LanguageModeling）语种识别（LanguageIdentification）句子边界检测（SentenceBoundaryDetection）NLP任务总结

Taxonomy

Taxonomy对给定文本进行分析和理解，形成能母够表达酒义的形式化表示或分布式表示调义消线（WordSenseDisambiguation）语义角色标注（Semantic.RoleLabeling）热象义表示分折（AbstractMeaningRepresentationParsing）语义分析（SemanticAnalysis）i通翔滨(FirstOrderPredicateCalculus)NLP任务总结框荣语义分析（FrameSemanticParsing）调汇/购子/段落的向量化表示（Word/Sentence/ParagraphVector）从天结物文本中抽取结化的信息命名实体识（NamedEntityRecognition）实体消装（EntityDisambiguation）冰语取（Terminology/GiossaryExtraction）共指解（CoreferenceResolution）信息抽取（InformationExtraction）关系热取（RelationshipExtraction）事件热取（EventExtraction）博感分析（SentimentAnalysis）意图别（IntentDetection）槽位填充（SlotFilling）直接面向普遇用户，提供自然语言处理产品服务的系统级任务，会用到多个量的自然语言处理技术机器胞泽（MachineTranslation）文本换要（Text：summarization/Simplication）向籍系统（Question-AnsweringSysterm）质层任务（High-levelTasks对活系统（DialogueSysterm）阅读理（ReadingComprehension）自动文量分级（AutomaticEssavGrading）

Taxonomy

TaxonomyNature Language ProcessingNature LanguageNature LanguageUnderstandingGernerationPoStaggingSpellingCheckSemantic ParsingGrammarCorrectionRelationExtractionText SummarizationNamed EntityRecongnationQuestions-AnswersMachineTranslationCoreference ResolutionSentimentanalysisPoemsGeneration

Taxonomy Nature Language Processing Nature Language Understanding Nature Language Gerneration . POS tagging Named Entity Recongnation Relation Extraction Semantic Parsing Coreference Resolution Sentiment analysis Questions-Answers Spelling Check Grammar Correction Machine Translation Text Summarization Poems Generation . . POS tagging Named Entity Recongnation Relation Extraction Semantic Parsing Coreference Resolution Sentiment analysis

Outline> Taxonomy>Part-of-speech> Parsing

Ø Taxonomy Ø Part-of-speech Ø Parsing Outline

POstaggingConceptsPart-of-speech (POS) tagging交道大学

POS tagging • Part-of-speech (POS) tagging Concepts

PostaggingConceptsPart-of-speech (POS) taggingProcessof markingup aword ascorrespondingtoaparticular part of speechafter word segmentation such as nouns, verbs, adjectives, adverbs, etc.交通大学

POS tagging • Part-of-speech (POS) tagging • Process of marking up a word as corresponding to a particular part of speech after word segmentation such as nouns, verbs, adjectives, adverbs, etc. Concepts

PostaggingConceptsPart-of-speech (POS) taggingProcess of marking up a word as corresponding to a particular part of speechafterword segmentation such as nouns,verbs, adjectives, adverbs, etcBasisofhigh-levelNLPtasks交通大学

POS tagging • Part-of-speech (POS) tagging • Process of marking up a word as corresponding to a particular part of speech after word segmentation such as nouns, verbs, adjectives, adverbs, etc. • Basis of high-level NLP tasks. Concepts