Browse using
OpenLink Faceted Browser
OpenLink Structured Data Editor
LodLive Browser
Formats
RDF:
N-Triples
N3
Turtle
JSON
XML
OData:
Atom
JSON
Microdata:
JSON
HTML
Embedded:
JSON
Turtle
Other:
CSV
JSON-LD
Faceted Browser
Sparql Endpoint
About:
Lexical analysis
An Entity of Type:
Thing
,
from Named Graph:
http://dbpedia.org
,
within Data Space:
dbpedia.org
Computing process of parsing a sequence of characters into a sequence of tokens
Property
Value
dbo:
description
프로그래밍 언어를 처리하는 처리하는 최초의 단계
(ko)
文字列を解析してトークン列に分解する計算処理
(ja)
процесс разбора входной последовательности символов на лексемы
(ru)
Computerprogramm zur Zerlegung von Plain text
(de)
computing process of parsing a sequence of characters into a sequence of tokens
(en)
datorprocess som tolkar en sträng av tecken och ger en sträng av lexikalska enheter
(sv)
transformation d'une suite de caractères (un texte) en une suite de mots, appelés lexèmes
(fr)
将输入的字符序列转换为单词符号序列的过程
(zh)
dbo:
wikiPageExternalLink
http://people.cs.nctu.edu.tw/~wuuyang/homepage/papers/applicability2002.ps
https://web.archive.org/web/20190530155339/https:/www.ibm.com/developerworks/community/blogs/nlp/entry/tokenization%3Flang=en
http://www.gabormelli.com/RKB/Word_Mention_Segmentation_Task
https://www.ibm.com/developerworks/community/blogs/nlp/entry/tokenization
dbo:
wikiPageWikiLink
dbr
:Numerical_digit
dbr
:Part_of_speech
dbr
:English_language
dbr
:JavaScript
dbr
:Natural_language
dbr
:Typedef
dbc
:Compiler_construction
dbc
:Lexical_analysis
dbr
:BCPL
dbr
:C_(programming_language)
dbr
:Chinese_language
dbr
:Computer_science
dbr
:Programming_language
dbr
:Python_(programming_language)
dbr
:Thai_language
dbr
:Word
dbr
:Natural_language_processing
dbr
:Abstract_syntax_tree
dbr
:Go_(programming_language)
dbr
:Character_(computing)
dbr
:Emoticon
dbr
:Parser
dbr
:Language_model
dbr
:Statement_(computer_science)
dbr
:Identifier_(computer_languages)
dbr
:Ancient_Greek
dbr
:Lex_(software)
dbr
:Backtracking
dbr
:Word_(computer_architecture)
dbr
:Semantic_analysis_(compilers)
dbr
:Computer_program
dbr
:Web_page
dbr
:Scriptio_continua
dbr
:Finite-state_machine
dbr
:Hyphen
dbr
:Newline
dbr
:Regular_expression
dbr
:String_(computer_science)
dbr
:Lexeme
dbr
:Formal_grammar
dbr
:Off-side_rule
dbr
:Structure_and_Interpretation_of_Computer_Programs
dbr
:Morpheme
dbr
:Literal_(computer_programming)
dbr
:Comment_(computer_programming)
dbr
:Operator_(computer_programming)
dbr
:Regular_language
dbr
:Agglutinative_language
dbr
:Flex_(lexical_analyser_generator)
dbr
:Lexical_grammar
dbr
:ALGOL
dbr
:Bash_(Unix_shell)
dbr
:Data_type
dbr
:Parsing
dbr
:Poetic_contraction
dbr
:Stropping_(syntax)
dbr
:Whitespace_character
dbr
:Context-free_grammar
dbr
:Domain-specific_language
dbr
:Reserved_word
dbr
:Block_(programming)
dbr
:Yacc
dbr
:Prettyprint
dbr
:GNU_Bison
dbr
:Lint_(software)
dbr
:Syntax_(programming_languages)
dbr
:Delimiter
dbr
:String_literal
dbr
:Re2c
dbr
:Maximal_munch
dbc
:Parsing
dbc
:Programming_language_implementation
dbr
:Integer_literal
dbr
:URI
dbr
:Flag_(computing)
dbr
:Compiling
dbr
:State_transition_table
dbr
:Parser_generator
dbr
:The_lexer_hack
dbr
:Defensive_semicolon
dbr
:Line_continuation
dbr
:Line_reconstruction
dbr
:Compiler_frontend
dbr
:List_of_parser_generators
dbr
:Trailing_comma
dbp:
wikiPageUsesTemplate
dbt
:Natural_Language_Processing
dbt
:Also
dbt
:Citation_needed
dbt
:Cite_journal
dbt
:Cite_web
dbt
:Code
dbt
:Dubious
dbt
:Further
dbt
:ISBN
dbt
:Redirect
dbt
:Redirect-several
dbt
:Refbegin
dbt
:Refend
dbt
:Reflist
dbt
:See_also
dbt
:Short_description
dct:
subject
dbc
:Compiler_construction
dbc
:Lexical_analysis
dbc
:Parsing
dbc
:Programming_language_implementation
gold:
hypernym
dbr
:Process
rdf:
type
owl
:Thing
owl
:Thing
rdfs:
label
Lexical analysis
(en)
Lexikální analýza
(cs)
Anàlisi lèxica
(ca)
تحليل المفردات
(ar)
Λεκτική ανάλυση
(el)
Lexikalische Analyse
(de)
Analizador léxico
(es)
Analisis leksikal
(in)
Analyse lexicale
(fr)
字句解析
(ja)
Analisi lessicale
(it)
낱말 분석
(ko)
Lexicale analyse
(nl)
Analiza leksykalna
(pl)
Análise léxica
(pt)
Лексический анализ
(ru)
Лексичний аналіз
(uk)
Lexikalanalys
(sv)
词法分析
(zh)
rdfs:
seeAlso
dbr
:Word
dbr
:Compiler-compiler
owl:
sameAs
yago-res
:Lexical analysis
freebase
:Lexical analysis
wikidata
:Lexical analysis
dbpedia-de
:Lexical analysis
dbpedia-es
:Lexical analysis
dbpedia-it
:Lexical analysis
dbpedia-nl
:Lexical analysis
dbpedia-pl
:Lexical analysis
dbpedia-tr
:Lexical analysis
dbpedia-fr
:Lexical analysis
dbpedia-da
:Lexical analysis
dbpedia-he
:Lexical analysis
dbpedia-ja
:Lexical analysis
dbpedia-pt
:Lexical analysis
dbpedia-ru
:Lexical analysis
dbpedia-zh
:Lexical analysis
dbpedia-sv
:Lexical analysis
dbpedia-vi
:Lexical analysis
dbpedia-el
:Lexical analysis
dbpedia-id
:Lexical analysis
dbpedia-ko
:Lexical analysis
dbpedia-ca
:Lexical analysis
dbpedia-ar
:Lexical analysis
dbpedia-az
:Lexical analysis
dbpedia-cs
:Lexical analysis
dbpedia-fa
:Lexical analysis
dbpedia-hr
:Lexical analysis
dbpedia-hy
:Lexical analysis
dbpedia-mk
:Lexical analysis
dbpedia-ms
:Lexical analysis
dbpedia-no
:Lexical analysis
dbpedia-sr
:Lexical analysis
dbpedia-ta
:Lexical analysis
dbpedia-uk
:Lexical analysis
dbpedia-global
:Lexical analysis
prov:
wasDerivedFrom
wikipedia-en
:Lexical_analysis?oldid=1309109190&ns=0
foaf:
isPrimaryTopicOf
wikipedia-en
:Lexical_analysis
is
dbo:
genre
of
dbr
:Re2c__re2c__1
dbr
:RE/flex
dbr
:Flex_(lexical_analyser_generator)
is
dbo:
wikiPageDisambiguates
of
dbr
:Lexical
is
dbo:
wikiPageRedirects
of
dbr
:Tokenization_(lexical_analysis)
dbr
:Lexical_token
dbr
:Automatic_semicolon_insertion
dbr
:Scanner_(computing)
dbr
:Lexeme_(computer_science)
dbr
:Lexer
dbr
:Lexer_(computer_science)
dbr
:Lexer_generator
dbr
:Lexers
dbr
:Lexical_Analysis
dbr
:Lexical_analyser
dbr
:Lexical_analyzer
dbr
:Lexical_parser
dbr
:Lexical_syntax
dbr
:Lexing
dbr
:Token_(parser)
dbr
:Token_scanner
dbr
:Token_splitting
dbr
:Tokenise
dbr
:Tokeniser
dbr
:Tokenize
dbr
:Tokenized
dbr
:Tokenizer
dbr
:Tokenizing
dbr
:List_of_lexer_generators
dbr
:Semicolon_insertion
is
dbo:
wikiPageWikiLink
of
dbr
:Here_document
dbr
:Glasgow_Haskell_Compiler
dbr
:The_Art_of_Computer_Programming
dbr
:BASIC_Stamp
dbr
:GW-BASIC
dbr
:Text_mining
dbr
:BASIC_interpreter
dbr
:TI-BASIC
dbr
:Text_segmentation
dbr
:Finite-state_transducer
dbr
:Tokenization_(lexical_analysis)
dbr
:S/SL_programming_language
dbr
:JetPAG
dbr
:Lexical_token
dbr
:Semantic_analysis_(linguistics)
dbr
:Marathi_language
dbr
:MySQL
dbr
:XML
dbr
:Ragel
dbr
:Scanner
dbr
:Parboiled_(Java)
dbr
:ZPE_Programming_Environment
dbr
:Microsoft_Phoenix
dbr
:Name_resolution_(programming_languages)
dbr
:Bell_Labs
dbr
:C_Sharp_(programming_language)
dbr
:Compiler
dbr
:Perl
dbr
:Programming_language
dbr
:Roslyn_(compiler)
dbr
:Seed7
dbr
:Uralic_languages
dbr
:Pattern_matching
dbr
:Search_engine_indexing
dbr
:General_Architecture_for_Text_Engineering
dbr
:GFA_BASIC
dbr
:Translation_unit_(programming)
dbr
:C_shell
dbr
:Camel_case
dbr
:PDF
dbr
:IBM_BASIC
dbr
:Lemon_(parser_generator)
dbr
:Coco/R
dbr
:SYNTAX
dbr
:Attention_(machine_learning)
dbr
:Apache_cTAKES
dbr
:Recursive_transition_network
dbr
:Rule-based_system
dbr
:Identifier_(computer_languages)
dbr
:Lex_(software)
dbr
:Book_of_Dede_Korkut
dbr
:Shift-reduce_parser
dbr
:Preprocessor
dbr
:ULTRA_(machine_translation_system)
dbr
:GRASS_(programming_language)
dbr
:Kenneth_E._Iverson
dbr
:Enterprise_search
dbr
:Interpreter_(computing)
dbr
:Finite-state_machine
dbr
:Minimalist_program
dbr
:Regular_expression
dbr
:Software_bug
dbr
:JavaScript_syntax
dbr
:XPL
dbr
:Automata-based_programming
dbr
:VTD-XML
dbr
:ZX81_character_set
dbr
:RE/flex
dbr
:RiTa
dbr
:Symbol_table
dbr
:Shallow_parsing
dbr
:Analysis
dbr
:Eric_Schmidt
dbr
:Off-side_rule
dbr
:Standard_Generalized_Markup_Language
dbr
:Deterministic_finite_automaton
dbr
:Literal_(computer_programming)
dbr
:Turkoman_(ethnonym)
dbr
:GLib
dbr
:Doxygen
dbr
:Cohesion_(computer_science)
dbr
:Content_similarity_detection
dbr
:List_of_programming_languages_by_type
dbr
:Operator_(computer_programming)
dbr
:English-Arabic_Parallel_Corpus_of_United_Nations_Texts
dbr
:Asymmetry
dbr
:Flex_(lexical_analyser_generator)
dbr
:43_Things
dbr
:Spider_trap
dbr
:Lexical_grammar
dbr
:Compilers:_Principles,_Techniques,_and_Tools
dbr
:Uniform_Resource_Identifier
dbr
:OCaml
dbr
:Parsing
dbr
:Haskell_Platform
dbr
:Semantria
dbr
:Language-based_security
dbr
:ZX80_character_set
dbr
:Sigil_(computer_programming)
dbr
:Stropping_(syntax)
dbr
:C_syntax
dbr
:Dartmouth_BASIC
dbr
:HP_Time-Shared_BASIC
dbr
:Locomotive_BASIC
dbr
:ANTLR
dbr
:BASIC09
dbr
:Eqn_(software)
dbr
:Comparison_of_programming_languages_(syntax)
dbr
:Library_management
dbr
:TeXstudio
dbr
:Programming_language_theory
dbr
:Software_development_effort_estimation
dbr
:Metaprogramming
dbr
:Domain-specific_language
dbr
:List_of_algorithms
dbr
:Earley_parser
dbr
:One_Definition_Rule
dbr
:Precompiled_header
dbr
:Lexicology
dbr
:GNU_Bison
dbr
:JavaCC
dbr
:LR_parser
dbr
:Scope_(computer_science)
dbr
:RIPS
dbr
:List_of_formal_language_and_literal_string_topics
dbr
:Syntax_(programming_languages)
dbr
:Natural_Language_Toolkit
dbr
:Stack-oriented_programming
dbr
:Analyser
dbr
:History_of_compiler_construction
dbr
:String_literal
dbr
:Direct_voice_input
dbr
:Scannerless_parsing
dbr
:SGLR
dbr
:Re2c
dbr
:Binary_Application_Markup_Language
dbr
:Raku_rules
dbr
:Patrick_Hanks
dbr
:PQCC
dbr
:Lexer_hack
dbr
:Printf_format_string
dbr
:Lexical
dbr
:Integer_literal
dbr
:Haskell_features
dbr
:Perl_virtual_machine
dbr
:Criticism_of_C++
dbr
:Sarah_(chimpanzee)
dbr
:Irony_(framework)
dbr
:Software_forensics
dbr
:TenTen_Corpus_Family
dbr
:BulNet
dbr
:Toi_(programming_language)
dbr
:Ruzzo–Tompa_algorithm
dbr
:Google_Ngram_Viewer
dbr
:PackCC
dbr
:Gastarbeiterdeutsch
dbr
:Parameter_word
dbr
:Transformer_(machine_learning_model)
dbr
:Automatic_semicolon_insertion
dbr
:Scanner_(computing)
dbr
:Lexeme_(computer_science)
dbr
:Lexer
dbr
:Lexer_(computer_science)
dbr
:Lexer_generator
dbr
:Lexers
dbr
:Lexical_Analysis
dbr
:Lexical_analyser
dbr
:Lexical_analyzer
dbr
:Lexical_parser
dbr
:Lexical_syntax
dbr
:Lexing
dbr
:Token_(parser)
dbr
:Token_scanner
dbr
:Token_splitting
dbr
:Tokenise
dbr
:Tokeniser
dbr
:Tokenize
dbr
:Tokenized
dbr
:Tokenizer
dbr
:Tokenizing
dbr
:List_of_lexer_generators
dbr
:Semicolon_insertion
is
dbp:
genre
of
dbr
:RE/flex
is
foaf:
primaryTopic
of
wikipedia-en
:Lexical_analysis
This content was extracted from
Wikipedia
and is licensed under the
Creative Commons Attribution-ShareAlike 4.0 International