congrats Icon
New! Announcing our next generation AI code completions
Read here
Tabnine Logo
Lexer
Code IndexAdd Tabnine to your IDE (free)

How to use
Lexer
in
com.intellij.lexer

Best Java code snippets using com.intellij.lexer.Lexer (Showing top 20 results out of 315)

  • Add the Codota plugin to your IDE and get smart completions
private void myMethod () {
List l =
  • Codota Iconnew ArrayList()
  • Codota Iconnew LinkedList()
  • Smart code suggestions by Tabnine
}
origin: KronicDeth/intellij-elixir

public void advance() {
  if (eexLexer.getTokenType() == ELIXIR) {
    elixirLexer.advance();
    if (elixirLexer.getTokenType() == null) {
      eexLexer.advance();
    }
  } else {
    eexLexer.advance();
    if (eexLexer.getTokenType() == ELIXIR) {
      // start automatically does equivalent of `advance` since `elixirLexer` is also a look-ahead lexer
      elixirLexer.start(getBufferSequence(), eexLexer.getTokenStart(), eexLexer.getTokenEnd());
    }
  }
}
origin: KronicDeth/intellij-elixir

public int getBufferEnd() {
  // since {@link #getBufferSequence} uses `eexLexer`, so does this.
  return eexLexer.getBufferEnd();
}
origin: KronicDeth/intellij-elixir

@NotNull
public CharSequence getBufferSequence() {
  // elixirLexer only has a subsequence that is `eexLexer`'s
  return eexLexer.getBufferSequence();
}
origin: KronicDeth/intellij-elixir

Position(final EmbeddedElixir lexer) {
  this.eexPosition = lexer.eexLexer.getCurrentPosition();
  if (lexer.eexLexer.getTokenType() == ELIXIR) {
    this.elixirPosition = lexer.elixirLexer.getCurrentPosition();
  } else {
    this.elixirPosition = null;
  }
}
origin: KronicDeth/intellij-elixir

@Override
public void start(@NotNull CharSequence buffer, int startOffset, int endOffset, int initialState) {
  eexLexer.start(buffer, startOffset, endOffset, initialState & 0xFFFF);
  if (eexLexer.getTokenType() == ELIXIR) {
    elixirLexer.start(buffer, startOffset, endOffset);
  } else {
    elixirLexer.start(buffer, startOffset, endOffset);
  }
}
origin: KronicDeth/intellij-elixir

private void restoreElixirPosition(@Nullable LexerPosition elixirPosition) {
  if (elixirPosition != null) {
    elixirLexer.start(getBufferSequence(), eexLexer.getTokenStart(), eexLexer.getTokenEnd());
    elixirLexer.restore(elixirPosition);
  }
}
origin: Camelcade/Perl5-IDEA

 private void lexToken(Lexer lexer) {
  myTokenType = lexer.getTokenType();
  if (myTokenType == LEFT_BRACE_CODE_START) {
   myTokenType = LEFT_BRACE;
  }
  myTokenStart = lexer.getTokenStart();
  myState = lexer.getState();
  myTokenEnd = lexer.getTokenEnd();
  lexer.advance();
 }
}
origin: KronicDeth/intellij-elixir

  @Override
  public IElementType merge(final IElementType type, final Lexer originalLexer) {
    IElementType mergedTokenType;
    if (type != DATA) {
      while (true) {
        IElementType originalTokenType = originalLexer.getTokenType();
        if (originalTokenType != null && originalTokenType != DATA) {
          originalLexer.advance();
        } else {
          break;
        }
      }
      mergedTokenType = EEX;
    } else {
      mergedTokenType = type;
    }
    return mergedTokenType;
  }
}
origin: KronicDeth/intellij-elixir

public int getTokenStart() {
  return lexer().getTokenStart();
}
origin: KronicDeth/intellij-elixir

protected void start(@NotNull CharSequence charSequence) {
  lexer.start(charSequence);
}
origin: KronicDeth/intellij-elixir

@Contract(pure = true)
@Nullable
private static <T> T forLanguage(@NotNull Lexer eexLexer, @NotNull T forEEx, @Nullable T forElixir) {
  return forLanguage(eexLexer.getTokenType(), forEEx, forElixir);
}
origin: BashSupport/BashSupport

@Override
public void restore(@NotNull final LexerPosition position) {
  final int prefixLength = prefix.length();
  final int newOffset = position.getOffset() - prefixLength;
  if (newOffset == 0) {
    this.afterPrefix = false;
  }
  if (newOffset < myDelegate.getBufferEnd()) {
    this.delegateEOF = false;
    this.afterEOF = false;
  }
  myDelegate.restore(new LexerPosition() {
    @Override
    public int getOffset() {
      return newOffset;
    }
    @Override
    public int getState() {
      return position.getState();
    }
  });
}
origin: KronicDeth/intellij-elixir

public int getTokenEnd() {
  return lexer().getTokenEnd();
}
origin: KronicDeth/intellij-elixir

private void restoreEExPosition(@NotNull LexerPosition eexPosition) {
  eexLexer.restore(eexPosition);
}
origin: KronicDeth/intellij-elixir

public int getState() {
  return lexer().getState() | (lexerLanguageFlag() << 16);
}
origin: BashSupport/BashSupport

@Override
public void advance() {
  if (afterPrefix) {
    myDelegate.advance();
  }
  afterPrefix = true;
  afterEOF |= delegateEOF;
  delegateEOF |= myDelegate.getTokenType() == null;
}
origin: BashSupport/BashSupport

@Override
public int getTokenStart() {
  int tokenStart = myDelegate.getTokenStart();
  if (!afterPrefix && tokenStart == 0) {
    return 0;
  }
  if (afterEOF) {
    return prefix.length() + suffix.length() + tokenStart;
  }
  return prefix.length() + tokenStart;
}
origin: Camelcade/Perl5-IDEA

@Override
public void start(@NotNull CharSequence buffer, int startOffset, int endOffset, int initialState) {
 if (initialState == 0 && myTryCatchEnabled) {
  initialState = -1;
 }
 myMainLexer.start(buffer, startOffset, endOffset, initialState);
 myTokenStart = myTokenEnd = startOffset;
 myTokenType = null;
 myIsSublexing = false;
}
origin: KronicDeth/intellij-elixir

@Nullable
public IElementType getTokenType() {
  IElementType tokenType = lexer().getTokenType();
  if (tokenType != null && tokenType.getLanguage() != ElixirLanguage.INSTANCE) {
    IElementType elixirTokenType = EEX_TOKEN_TYPE_TO_ELIXIR_TOKEN_TYPE.get(tokenType);
    assert elixirTokenType != null : "EEx TokenType " + tokenType + " is not mapped to an Elixir TokenType";
    tokenType = elixirTokenType;
  }
  return tokenType;
}
origin: BashSupport/BashSupport

@Override
public int getTokenEnd() {
  if (!afterPrefix) {
    return prefix.length();
  }
  int tokenEnd = myDelegate.getTokenEnd();
  if (delegateEOF) {
    return prefix.length() + suffix.length() + tokenEnd;
  }
  return prefix.length() + tokenEnd;
}
com.intellij.lexerLexer

Most used methods

  • getTokenStart
  • start
  • advance
  • getBufferEnd
  • getTokenEnd
  • getTokenType
  • getBufferSequence
  • getState
  • restore
  • getCurrentPosition
  • getTokenSequence
  • getTokenText
  • getTokenSequence,
  • getTokenText

Popular in Java

  • Reading from database using SQL prepared statement
  • addToBackStack (FragmentTransaction)
  • getExternalFilesDir (Context)
  • getContentResolver (Context)
  • GridLayout (java.awt)
    The GridLayout class is a layout manager that lays out a container's components in a rectangular gri
  • Point (java.awt)
    A point representing a location in (x,y) coordinate space, specified in integer precision.
  • Window (java.awt)
    A Window object is a top-level window with no borders and no menubar. The default layout for a windo
  • JFrame (javax.swing)
  • DateTimeFormat (org.joda.time.format)
    Factory that creates instances of DateTimeFormatter from patterns and styles. Datetime formatting i
  • Location (org.springframework.beans.factory.parsing)
    Class that models an arbitrary location in a Resource.Typically used to track the location of proble
  • Top 12 Jupyter Notebook Extensions
Tabnine Logo
  • Products

    Search for Java codeSearch for JavaScript code
  • IDE Plugins

    IntelliJ IDEAWebStormVisual StudioAndroid StudioEclipseVisual Studio CodePyCharmSublime TextPhpStormVimAtomGoLandRubyMineEmacsJupyter NotebookJupyter LabRiderDataGripAppCode
  • Company

    About UsContact UsCareers
  • Resources

    FAQBlogTabnine AcademyStudentsTerms of usePrivacy policyJava Code IndexJavascript Code Index
Get Tabnine for your IDE now