Packages

  • package root
    Definition Classes
    root
  • package io
    Definition Classes
    root
  • package shiftleft
    Definition Classes
    io
  • package semanticcpg

    Domain specific language for querying code property graphs

    Domain specific language for querying code property graphs

    This is the API reference for the CPG query language, a language to mine code for defects and vulnerabilities both interactively on a code analysis shell (REPL), or using non-interactive scripts.

    Queries written in the CPG query language express graph traversals (see https://en.wikipedia.org/wiki/Graph_traversal). Similar to the standard graph traversal language "Gremlin" (see https://en.wikipedia.org/wiki/Gremlin_(programming_language))) these traversals are formulated as sequences of primitive language elements referred to as "steps". You can think of a step as a small program, similar to a unix shell utility, however, instead of processing lines one by one, the step processes nodes of the graph.

    Starting a traversal

    All traversals begin by selecting a set of start nodes, e.g.,

    cpg.method

    will start the traversal at all methods, while

    cpg.local

    will start at all local variables. The complete list of starting points can be found at

    io.shiftleft.codepropertygraph.Cpg

    Lazy evaluation

    Queries are lazily evaluated, e.g., cpg.method creates a traversal which you can add more steps to. You can, for example, evaluate the traversal by converting it to a list:

    cpg.method.toList

    Since toList is such a common operation, we provide the shorthand l, meaning that

    cpg.method.l

    provides the same result as the former query.

    Properties

    Nodes have "properties", key-value pairs where keys are strings and values are primitive data types such as strings, integers, or Booleans. Properties of nodes can be selected based on their key, e.g.,

    cpg.method.name

    traverses to all method names. Nodes can also be filtered based on properties, e.g.,

    cpg.method.name(".*exec.*")

    traverse to all methods where name matches the regular expression ".*exec.*". You can see a complete list of properties by browsing to the API documentation of the corresponding step. For example, you can find the properties of method nodes at io.shiftleft.semanticcpg.language.types.structure.MethodTraversal.

    Side effects

    Useful if you want to mutate something outside the traversal, or simply debug it: This prints all typeDecl names as it traverses the graph and increments i for each one.

    var i = 0
    cpg.typeDecl.sideEffect{typeTemplate => println(typeTemplate.name); i = i + 1}.exec

    [advanced] Selecting multiple things from your traversal

    If you are interested in multiple things along the way of your traversal, you label anything using the as modulator, and use select at the end. Note that the compiler automatically derived the correct return type as a tuple of the labelled steps, in this case with two elements.

    cpg.method.as("method").definingTypeDecl.as("classDef").select.toList
    // return type: List[(Method, TypeDecl)]

    [advanced] For comprehensions

    You can always start a new traversal from a node, e.g.,

    val someMethod = cpg.method.head
    someMethod.start.parameter.toList

    You can use this e.g. in a for comprehension, which is (in this context) essentially an alternative way to select multiple intermediate things. It is more expressive, but more computationally expensive.

    val query = for {
      method <- cpg.method
      param <- method.start.parameter
    } yield (method.name, param.name)
    
    query.toList
    Definition Classes
    shiftleft
  • package language

    Language for traversing the code property graph

    Language for traversing the code property graph

    Implicit conversions to specific steps, based on the node at hand. Automatically in scope when using anything in the steps package, e.g. Steps

    Definition Classes
    semanticcpg
  • package bindingextension
    Definition Classes
    language
  • package callgraphextension
    Definition Classes
    language
  • package dotextension
    Definition Classes
    language
  • package nodemethods
    Definition Classes
    language
  • package operatorextension
    Definition Classes
    language
  • package types
    Definition Classes
    language
  • AccessPathHandling
  • DefaultNodeExtensionFinder
  • HasLocation
  • HasStoreMethod
  • ICallResolver
  • LocationCreator
  • NewNodeSteps
  • NewNodeTypeDeco
  • NewTagNodePairTraversal
  • NoResolve
  • NodeExtensionFinder
  • NodeOrdering
  • NodeSteps
  • NodeTypeStarters
  • Show
  • Steps
  • TagTraversal

final class Steps[A] extends AnyVal

Base class for our DSL These are the base steps available in all steps of the query language. There are no constraints on the element types, unlike e.g. NodeSteps

Linear Supertypes
AnyVal, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Steps
  2. AnyVal
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new Steps(traversal: Traversal[A])

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    Any
  2. final def ##: Int
    Definition Classes
    Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def b: Buffer[A]

    Shorthand for toBuffer

  6. def getClass(): Class[_ <: AnyVal]
    Definition Classes
    AnyVal → Any
  7. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  8. def jl: List[A]

    Execute the traversal and convert it into a Java list (as opposed to the Scala list obtained via toList)

  9. def p(implicit show: Show[A] = Show.default): List[String]

    Execute this traversal and pretty print the results.

    Execute this traversal and pretty print the results. This may mean that not all properties of the node are displayed or that some properties have undergone transformations to improve display. A good example is flow pretty-printing. This is the only three of the methods which we may modify on a per-node-type basis, typically via implicits of type Show[NodeType].

    Annotations
    @Doc()
  10. def s: LazyList[A]

    Alias for toStream

  11. def toBuffer(): Buffer[A]

    Execute the traversal and convert it to a mutable buffer

  12. def toJson(pretty: Boolean): String
    Attributes
    protected
  13. def toJson: String

    Execute traversal and convert the result to json.

    Execute traversal and convert the result to json. toJson (export) contains the exact same information as toList, only in json format. Typically, the user will call this method upon inspection of the results of toList in order to export the data for processing with other tools.

    Annotations
    @Doc()
  14. def toJsonPretty: String

    Execute traversal and convert the result to pretty json.

    Execute traversal and convert the result to pretty json.

    Annotations
    @Doc()
  15. def toStream(): LazyList[A]

    Execute the travel and convert it to a Java stream.

  16. def toString(): String
    Definition Classes
    Any
  17. val traversal: Traversal[A]

Deprecated Value Members

  1. def exec(): List[A]

    Alias for toList

    Alias for toList

    Deprecated

Inherited from AnyVal

Inherited from Any

Ungrouped