Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit facbd32

Browse files
author
Robert Marsh
committed
Merge branch 'master' into rdmarsh/cpp/ir-callee-side-effects
2 parents 2fb1d4d + 0862004 commit facbd32

866 files changed

Lines changed: 26329 additions & 13998 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.codeqlmanifest.json

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
11
{ "provide": [ "*/ql/src/qlpack.yml",
2+
"*/ql/test/qlpack.yml",
3+
"*/upgrades/qlpack.yml",
24
"misc/legacy-support/*/qlpack.yml",
35
"misc/suite-helpers/qlpack.yml",
46
"codeql/.codeqlmanifest.json" ] }

CONTRIBUTING.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# Contributing to QL
1+
# Contributing to CodeQL
22

33
We welcome contributions to our standard library and standard checks. Got an idea for a new check, or how to improve an existing query? Then please go ahead and open a pull request!
44

@@ -9,13 +9,13 @@ Before we accept your pull request, we require that you have agreed to our Contr
99
If you have an idea for a query that you would like to share with other Semmle users, please open a pull request to add it to this repository.
1010
Follow the steps below to help other users understand what your query does, and to ensure that your query is consistent with the other Semmle queries.
1111

12-
1. **Consult the QL documentation for query writers**
12+
1. **Consult the documentation for query writers**
1313

14-
There is lots of useful documentation to help you write QL, ranging from information about query file structure to language-specific tutorials. For more information on the documentation available, see [Writing QL queries](https://help.semmle.com/QL/learn-ql/writing-queries/writing-queries.html) on [help.semmle.com](https://help.semmle.com).
14+
There is lots of useful documentation to help you write queries, ranging from information about query file structure to tutorials for specific target languages. For more information on the documentation available, see [Writing CodeQL queries](https://help.semmle.com/QL/learn-ql/writing-queries/writing-queries.html) on [help.semmle.com](https://help.semmle.com).
1515

16-
2. **Format your QL correctly**
16+
2. **Format your code correctly**
1717

18-
All of Semmle's standard QL queries and libraries are uniformly formatted for clarity and consistency, so we strongly recommend that all QL contributions follow the same formatting guidelines. If you use QL for Eclipse, you can auto-format your query in the [QL editor](https://help.semmle.com/ql-for-eclipse/Content/WebHelp/ql-editor.html). For more information, see the [QL style guide](https://github.com/Semmle/ql/blob/master/docs/ql-style-guide.md).
18+
All of Semmle's standard queries and libraries are uniformly formatted for clarity and consistency, so we strongly recommend that all contributions follow the same formatting guidelines. If you use QL for Eclipse, you can auto-format your query in the [QL editor](https://help.semmle.com/ql-for-eclipse/Content/WebHelp/ql-editor.html). For more information, see the [CodeQL style guide](https://github.com/Semmle/ql/blob/master/docs/ql-style-guide.md).
1919

2020
3. **Make sure your query has the correct metadata**
2121

@@ -29,7 +29,7 @@ Follow the steps below to help other users understand what your query does, and
2929
The `select` statement of your query must be compatible with the query type (determined by the `@kind` metadata property) for alert or path results to be displayed correctly in LGTM and QL for Eclipse.
3030
For more information on `select` statement format, see [Introduction to query files](https://help.semmle.com/QL/learn-ql/writing-queries/introduction-to-queries.html#select-clause) on help.semmle.com.
3131

32-
5. **Save your query in a `.ql` file in correct language directory in this repository**
32+
5. **Save your query in a `.ql` file in the correct language directory in this repository**
3333

3434
There are five language-specific directories in this repository:
3535

@@ -54,7 +54,7 @@ repositories, which might be made public. We might also use this information
5454
to contact you in relation to your contributions, as well as in the
5555
normal course of software development. We also store records of your
5656
CLA agreements. Under GDPR legislation, we do this
57-
on the basis of our legitimate interest in creating the QL product.
57+
on the basis of our legitimate interest in creating the CodeQL product.
5858

5959
Please do get in touch ([email protected]) if you have any questions about
6060
this or our data protection policies.

README.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,16 +1,16 @@
1-
# Semmle QL
1+
# CodeQL
22

3-
This open source repository contains the standard QL libraries and queries that power [LGTM](https://lgtm.com), and the other products that [Semmle](https://semmle.com) makes available to its customers worldwide.
3+
This open source repository contains the standard CodeQL libraries and queries that power [LGTM](https://lgtm.com), and the other products that [Semmle](https://semmle.com) makes available to its customers worldwide.
44

5-
## How do I learn QL and run queries?
5+
## How do I learn CodeQL and run queries?
66

7-
There is [extensive documentation](https://help.semmle.com/QL/learn-ql/) on getting started with writing QL.
8-
You can use the [interactive query console](https://lgtm.com/help/lgtm/using-query-console) on LGTM.com or the [QL for Eclipse](https://lgtm.com/help/lgtm/running-queries-ide) plugin to try out your queries on any open-source project that's currently being analyzed.
7+
There is [extensive documentation](https://help.semmle.com/QL/learn-ql/) on getting started with writing CodeQL.
8+
You can use the [interactive query console](https://lgtm.com/help/lgtm/using-query-console) on LGTM.com or the [QL for Eclipse](https://lgtm.com/help/lgtm/running-queries-ide) plugin to try out your queries on any open source project that's currently being analyzed.
99

1010
## Contributing
1111

12-
We welcome contributions to our standard library and standard checks. Do you have an idea for a new check, or how to improve an existing query? Then please go ahead and open a pull request! Before you do, though, please take the time to read our [contributing guidelines](CONTRIBUTING.md). You can also consult our [style guides](https://github.com/Semmle/ql/tree/master/docs) to learn how to format your QL for consistency and clarity, how to write query metadata, and how to write query help documentation for your query.
12+
We welcome contributions to our standard library and standard checks. Do you have an idea for a new check, or how to improve an existing query? Then please go ahead and open a pull request! Before you do, though, please take the time to read our [contributing guidelines](CONTRIBUTING.md). You can also consult our [style guides](https://github.com/Semmle/ql/tree/master/docs) to learn how to format your code for consistency and clarity, how to write query metadata, and how to write query help documentation for your query.
1313

1414
## License
1515

16-
The QL queries in this repository are licensed under [Apache License 2.0](LICENSE) by [Semmle](https://semmle.com).
16+
The code in this repository is licensed under [Apache License 2.0](LICENSE) by [Semmle](https://semmle.com).

change-notes/1.23/analysis-cpp.md

Lines changed: 15 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ The following changes in version 1.23 affect C/C++ analysis in all applications.
99
| **Query** | **Tags** | **Purpose** |
1010
|-----------------------------|-----------|--------------------------------------------------------------------|
1111
| Hard-coded Japanese era start date (`cpp/japanese-era/exact-era-date`) | reliability, japanese-era | This query is a combination of two old queries that were identical in purpose but separate as an implementation detail. This new query replaces Hard-coded Japanese era start date in call (`cpp/japanese-era/constructor-or-method-with-exact-era-date`) and Hard-coded Japanese era start date in struct (`cpp/japanese-era/struct-with-exact-era-date`). |
12+
| Signed overflow check (`cpp/signed-overflow-check`) | correctness, reliability | Finds overflow checks that rely on signed integer addition to overflow, which has undefined behavior. Example: `a + b < a`. |
1213

1314
## Changes to existing queries
1415

@@ -23,8 +24,10 @@ The following changes in version 1.23 affect C/C++ analysis in all applications.
2324
| Too many arguments to formatting function (`cpp/too-many-format-arguments`) | Fewer false positive results | Fixed false positives resulting from mistmatching declarations of a formatting function. |
2425
| Unclear comparison precedence (`cpp/comparison-precedence`) | Fewer false positive results | False positives involving template classes and functions have been fixed. |
2526
| Comparison of narrow type with wide type in loop condition (`cpp/comparison-with-wider-type`) | Higher precision | The precision of this query has been increased to "high" as the alerts from this query have proved to be valuable on real-world projects. With this precision, results are now displayed by default in LGTM. |
27+
| Non-constant format string (`cpp/non-constant-format`) | Fewer false positive results | Fixed false positives resulting from mistmatching declarations of a formatting function. |
28+
| Wrong type of arguments to formatting function (`cpp/wrong-type-format-argument`) | More correct results and fewer false positive results | This query now understands explicitly specified argument numbers in format strings, such as the `1$` in `%1$s`. |
2629

27-
## Changes to QL libraries
30+
## Changes to libraries
2831

2932
* The data-flow library has been extended with a new feature to aid debugging.
3033
Instead of specifying `isSink(Node n) { any() }` on a configuration to
@@ -39,14 +42,25 @@ The following changes in version 1.23 affect C/C++ analysis in all applications.
3942
definition of `x` when `x` is a variable of pointer type. It no longer
4043
considers deep paths such as `f(&x.myField)` to be definitions of `x`. These
4144
changes are in line with the user expectations we've observed.
45+
* The data-flow library now makes it easier to specify barriers/sanitizers
46+
arising from guards by overriding the predicate
47+
`isBarrierGuard`/`isSanitizerGuard` on data-flow and taint-tracking
48+
configurations respectively.
4249
* There is now a `DataFlow::localExprFlow` predicate and a
4350
`TaintTracking::localExprTaint` predicate to make it easy to use the most
4451
common case of local data flow and taint: from one `Expr` to another.
4552
* The member predicates of the `FunctionInput` and `FunctionOutput` classes have been renamed for
4653
clarity (e.g. `isOutReturnPointer()` to `isReturnValueDeref()`). The existing member predicates
4754
have been deprecated, and will be removed in a future release. Code that uses the old member
4855
predicates should be updated to use the corresponding new member predicate.
56+
* The predicates `Declaration.hasStdName()` and `Declaration.hasGlobalOrStdName`
57+
have been added, simplifying handling of C++ standard library functions.
4958
* The control-flow graph is now computed in QL, not in the extractor. This can
5059
lead to regressions (or improvements) in how queries are optimized because
5160
optimization in QL relies on static size estimates, and the control-flow edge
5261
relations will now have different size estimates than before.
62+
* Support has been added for non-type template arguments. This means that the
63+
return type of `Declaration::getTemplateArgument()` and
64+
`Declaration::getATemplateArgument` have changed to `Locatable`. See the
65+
documentation for `Declaration::getTemplateArgument()` and
66+
`Declaration::getTemplateArgumentKind()` for details.

change-notes/1.23/analysis-csharp.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,10 @@ The following changes in version 1.23 affect C# analysis in all applications.
88

99
| **Query** | **Tags** | **Purpose** |
1010
|-----------------------------|-----------|--------------------------------------------------------------------|
11+
| Deserialized delegate (`cs/deserialized-delegate`) | security, external/cwe/cwe-502 | Finds unsafe deserialization of delegate types. |
12+
| Deserialization of untrusted data (`cs/unsafe-deserialization-untrusted-input`) | security, external/cwe/cwe-502 | Finds flow of untrusted input to calls to unsafe deserializers. |
1113
| Unsafe year argument for 'DateTime' constructor (`cs/unsafe-year-construction`) | reliability, date-time | Finds incorrect manipulation of `DateTime` values, which could lead to invalid dates. |
14+
| Unsafe deserializer (`cs/unsafe-deserialization`) | security, external/cwe/cwe-502 | Finds calls to unsafe deserializers. |
1215
| Mishandling the Japanese era start date (`cs/mishandling-japanese-era`) | reliability, date-time | Finds hard-coded Japanese era start dates that could be invalid. |
1316

1417
## Changes to existing queries
@@ -24,7 +27,7 @@ The following changes in version 1.23 affect C# analysis in all applications.
2427

2528
* `nameof` expressions are now extracted correctly when the name is a namespace.
2629

27-
## Changes to QL libraries
30+
## Changes to libraries
2831

2932
* The new class `NamespaceAccess` models accesses to namespaces, for example in `nameof` expressions.
3033
* The data-flow library now makes it easier to specify barriers/sanitizers
@@ -43,5 +46,7 @@ The following changes in version 1.23 affect C# analysis in all applications.
4346
* There is now a `DataFlow::localExprFlow` predicate and a
4447
`TaintTracking::localExprTaint` predicate to make it easy to use the most
4548
common case of local data flow and taint: from one `Expr` to another.
49+
* Data is now tracked through null-coalescing expressions (`??`).
50+
* A new library `semmle.code.csharp.Unification` has been added. This library exposes two predicates `unifiable` and `subsumes` for calculating type unification and type subsumption, respectively.
4651

4752
## Changes to autobuilder

change-notes/1.23/analysis-java.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ The following changes in version 1.23 affect Java analysis in all applications.
1919
| Query built without neutralizing special characters (`java/concatenated-sql-query`) | More results | The query now identifies arguments to `Statement.executeLargeUpdate` and `Connection.prepareCall` as SQL expressions sinks. |
2020
| Useless comparison test (`java/constant-comparison`) | Fewer false positives | Additional overflow check patterns are now recognized and no longer reported. |
2121

22-
## Changes to QL libraries
22+
## Changes to libraries
2323

2424
* The data-flow library has been extended with a new feature to aid debugging.
2525
Instead of specifying `isSink(Node n) { any() }` on a configuration to

change-notes/1.23/analysis-javascript.md

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,9 @@
22

33
## General improvements
44

5-
* Suppor for `globalThis` has been added.
5+
* Automatic classification of generated and minified files has been improved, in particular files generated by Doxygen are now recognized.
6+
7+
* Support for `globalThis` has been added.
68

79
* Support for the following frameworks and libraries has been improved:
810
- [firebase](https://www.npmjs.com/package/firebase)
@@ -12,8 +14,7 @@
1214

1315
* The call graph has been improved to resolve method calls in more cases. This may produce more security alerts.
1416

15-
* TypeScript 3.6 features are supported.
16-
17+
* TypeScript 3.6 and 3.7 features are now supported.
1718

1819
## New queries
1920

@@ -26,6 +27,7 @@
2627
| Use of returnless function (`js/use-of-returnless-function`) | maintainability, correctness | Highlights calls where the return value is used, but the callee never returns a value. Results are shown on LGTM by default. |
2728
| Useless regular expression character escape (`js/useless-regexp-character-escape`) | correctness, security, external/cwe/cwe-20 | Highlights regular expression strings with useless character escapes, indicating a possible violation of [CWE-20](https://cwe.mitre.org/data/definitions/20.html). Results are shown on LGTM by default. |
2829
| Unreachable method overloads (`js/unreachable-method-overloads`) | correctness, typescript | Highlights method overloads that are impossible to use from client code. Results are shown on LGTM by default. |
30+
| Ignoring result from pure array method (`js/ignore-array-result`) | maintainability, correctness | Highlights calls to array methods without side effects where the return value is ignored. Results are shown on LGTM by default. |
2931

3032
## Changes to existing queries
3133

@@ -44,8 +46,9 @@
4446
| Stored cross-site scripting (`js/stored-xss`) | Fewer false-positive results | The query now recognizes more sanitizers. |
4547
| Uncontrolled command line (`js/command-line-injection`) | More results | This query now treats responses from servers as untrusted. |
4648
| Uncontrolled data used in path expression (`js/path-injection`) | Fewer false-positive results | This query now recognizes calls to Express `sendFile` as safe in some cases. |
49+
| Unknown directive (`js/unknown-directive`) | Fewer false positive results | This query no longer flags uses of ":", which is sometimes used like a directive. |
4750

48-
## Changes to QL libraries
51+
## Changes to libraries
4952

5053
* `Expr.getDocumentation()` now handles chain assignments.
5154

change-notes/1.23/analysis-python.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,3 +20,8 @@
2020
|----------------------------|------------------------|------------|
2121
| Unreachable code | Fewer false positives | Analysis now accounts for uses of `contextlib.suppress` to suppress exceptions. |
2222
| `__iter__` method returns a non-iterator | Better alert message | Alert now highlights which class is expected to be an iterator. |
23+
24+
25+
## Changes to QL libraries
26+
27+
* Django library now recognizes positional arguments from a `django.conf.urls.url` regex (Django version 1.x)

change-notes/support/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Files moved to ``docs`` directory
22

3-
Now that all of the QL documentation is in this repository,
3+
Now that all of the CodeQL documentation is in this repository,
44
notes on the languages, compilers, and frameworks supported have moved.
55
They're now stored as part of the Sphinx ``support`` project with the other documentation:
66
``docs/language/support``.

cpp/ql/src/Best Practices/Unused Entities/UnusedStaticVariables.ql

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,7 @@ from Variable v
2121
where
2222
v.isStatic() and
2323
v.hasDefinition() and
24+
not v.isConstexpr() and
2425
not exists(VariableAccess a | a.getTarget() = v) and
2526
not v instanceof MemberVariable and
2627
not declarationHasSideEffects(v) and

0 commit comments

Comments
 (0)