Parsing natural language sentences in a context-sensitive manner is a challenging task in NLP due to the ambiguity and complexity of human language. Traditional parsing techniques often fail to accurately interpret syntactic structures when the meaning of words depends on their context. In this work, we propose a context-sensitive dependency parser using a multi-layered neural network architecture that integrates BERT-based contextual embeddings and BiLSTM layers. This approach enables the model to effectively capture long-range dependencies and syntactic relationships in sentences. The parser is trained and evaluated on the Universal Dependencies English Web Treebank dataset, achieving a head prediction accuracy of 66%. Visual output demonstrates the ability of the model to handle complex sentence structures such as conditional and coordinated clauses. This research establishes a foundation for future work in fully labeled dependency parsing and highlights the effectiveness of combining contextual embeddings with deep sequence modeling for robust syntactic analysis.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi Layered Neural Network for Context Sensitive Parsing Using BERT

  • Esha Nayak,
  • Swathi Pai,
  • Divya Naga Supritha Miriyala,
  • Megha Hosamani,
  • Sumaiya Pathan

摘要

Parsing natural language sentences in a context-sensitive manner is a challenging task in NLP due to the ambiguity and complexity of human language. Traditional parsing techniques often fail to accurately interpret syntactic structures when the meaning of words depends on their context. In this work, we propose a context-sensitive dependency parser using a multi-layered neural network architecture that integrates BERT-based contextual embeddings and BiLSTM layers. This approach enables the model to effectively capture long-range dependencies and syntactic relationships in sentences. The parser is trained and evaluated on the Universal Dependencies English Web Treebank dataset, achieving a head prediction accuracy of 66%. Visual output demonstrates the ability of the model to handle complex sentence structures such as conditional and coordinated clauses. This research establishes a foundation for future work in fully labeled dependency parsing and highlights the effectiveness of combining contextual embeddings with deep sequence modeling for robust syntactic analysis.