Thanks to visit codestin.com
Credit goes to github.com

Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
90 commits
Select commit Hold shift + click to select a range
4d9c497
Enable prism by default
damccorm Apr 11, 2025
99837ca
Clean up fallback code
damccorm Apr 11, 2025
e28e463
Clean up fallback code
damccorm Apr 11, 2025
837ba2f
Add missing base case
damccorm Apr 11, 2025
3233b69
Add missing base case
damccorm Apr 11, 2025
4929906
Fix tests
damccorm Apr 14, 2025
ad9b0dc
Fix tests
damccorm Apr 14, 2025
20370cb
exclude unsupported state
damccorm Apr 15, 2025
cbaa083
Merge branch 'master' of https://github.com/apache/beam into users/da…
damccorm Apr 16, 2025
7e13214
Merge branch 'master' of https://github.com/apache/beam into users/da…
damccorm May 12, 2025
a6db1a4
Exclude locally materialized results
damccorm May 12, 2025
1e49f55
Fix fallback/dupe execution
damccorm May 12, 2025
e6ca143
Fix some snippet tests
damccorm May 13, 2025
4e3a675
Disable argparse abbreviation
damccorm May 13, 2025
a9e07a7
Some test fixes for prism switch
damccorm May 14, 2025
94ad26a
Merge in master
damccorm May 14, 2025
bda68b1
lint
damccorm May 15, 2025
d8b3534
row fixes
damccorm May 15, 2025
c21dafa
Make row comp logic default
damccorm May 15, 2025
b8343e6
Add more yaml examples
damccorm May 15, 2025
e08ead5
Fix dataframes tests
damccorm May 16, 2025
095caca
Merge branch 'master' of https://github.com/apache/beam into users/da…
damccorm May 16, 2025
81e5c54
Examples fixes
damccorm May 16, 2025
9250510
type hints
damccorm May 16, 2025
3d613c5
Some more transform test fixes
damccorm May 17, 2025
81e5e8a
more test fixes
damccorm May 19, 2025
99c07a7
Merge branch 'master' of https://github.com/apache/beam into users/da…
damccorm May 29, 2025
d6ff73e
More generic error checks
damccorm May 29, 2025
9b8218a
Reshuffle tests
damccorm May 29, 2025
f62e442
enrichment error catching
damccorm May 30, 2025
22fafe7
more test fixes
damccorm May 30, 2025
5e75f32
Scope out external transforms
damccorm May 30, 2025
baf2468
simplify test
damccorm May 30, 2025
e057572
Fix more tests
damccorm May 30, 2025
e3e757b
Clean up test
damccorm Jun 2, 2025
77f682e
correct runner mode
damccorm Jun 2, 2025
a70a33f
ML tests
damccorm Jun 2, 2025
2678f7d
ib collect test
damccorm Jun 2, 2025
9b7703e
Make sure assertions dont fire in incorrect order
damccorm Jun 2, 2025
60f0918
ML test fixes
damccorm Jun 3, 2025
f04c952
typing
damccorm Jun 3, 2025
621749b
More fixes
damccorm Jun 3, 2025
81ac404
some more fixes
damccorm Jun 3, 2025
2b6c279
Another error fix
damccorm Jun 3, 2025
095b1a3
Temporarily set log level to debug
damccorm Jun 3, 2025
84ade39
yapf
damccorm Jun 3, 2025
998dccf
More error regex fixes
damccorm Jun 3, 2025
e3dfb34
Fix some error messages/metric tests
damccorm Jun 4, 2025
1af63b7
more generic tests
damccorm Jun 4, 2025
ce747b5
Upgrade logging to warning to see what is happening
damccorm Jun 5, 2025
9a7529d
Some more patches
damccorm Jun 6, 2025
8f76ca4
Wait until finish for test pipelines
damccorm Jun 9, 2025
7b43e33
Merge branch 'master' of https://github.com/apache/beam into users/da…
damccorm Jun 9, 2025
a10a882
fix test_always
damccorm Jun 9, 2025
8dccd5b
A few more small fixes
damccorm Jun 9, 2025
c0fc545
Merge in master
damccorm Jun 12, 2025
3f73418
Temporarily update logging
damccorm Jun 16, 2025
aa4b03b
Merge branch 'master' of https://github.com/apache/beam into users/da…
damccorm Jun 20, 2025
f21b94a
clean up merge
damccorm Jun 20, 2025
41c20e0
Some more exclusions
damccorm Jun 23, 2025
9aff0d1
Merge branch 'users/damccorm/prismByDefault' of https://github.com/ap…
damccorm Jun 23, 2025
8daca3b
regex isssues
damccorm Jun 23, 2025
34a4f13
Propogate original failure when using instruction cache
damccorm Jun 23, 2025
90edb60
Batching fix
damccorm Jun 23, 2025
544fe04
Trigger some postcommits
damccorm Jun 23, 2025
7f52afa
fmt
damccorm Jun 23, 2025
1efa877
More test fixes
damccorm Jun 23, 2025
6504c33
Fix a few more tests
damccorm Jun 24, 2025
50495a4
linting
damccorm Jun 24, 2025
2410ca6
Bump workflow timeout (#35420)
damccorm Jun 25, 2025
46bb8a9
linting/fixes
damccorm Jun 26, 2025
2d5cd07
Merge branch 'users/damccorm/prismByDefault' of https://github.com/ap…
damccorm Jun 26, 2025
051a4ed
Merge in master
damccorm Jun 26, 2025
7909c00
linting
damccorm Jun 26, 2025
2ca2f91
Avoid problem with temp file getting deleted
damccorm Jun 27, 2025
96d9f5b
Avoid problem with temp file getting deleted
damccorm Jun 27, 2025
8a8ed63
minor cleanup
damccorm Jun 27, 2025
83472ce
Some more minor fixes
damccorm Jun 27, 2025
6efda27
Merge branch 'master' of https://github.com/apache/beam into users/da…
damccorm Jun 27, 2025
8fde571
Merge in master
damccorm Jun 27, 2025
068d3a0
Fix test
damccorm Jun 27, 2025
a5dde5b
Fix another test with questionable assumptions
damccorm Jun 30, 2025
cb97e70
Dont wait on tmpfile being destroyed
damccorm Jun 30, 2025
3644d18
Merge branch 'master' of https://github.com/apache/beam into users/da…
damccorm Jul 1, 2025
9e2eb68
More regex checks
damccorm Jul 14, 2025
ae1054f
Merge in master
damccorm Jul 14, 2025
83ec444
Add more postcommits, clean up some error messages
damccorm Jul 14, 2025
c1e75b3
Clean up a few tests
damccorm Jul 14, 2025
fa1e54d
simplify test
damccorm Jul 14, 2025
9385804
Clean up test errors
damccorm Jul 14, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
linting
  • Loading branch information
damccorm committed Jun 26, 2025
commit 7909c00ea0f2508a0c72d7a0ee0d08e8482fc865
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,6 @@

import unittest
from io import StringIO
import json

import mock

Expand Down Expand Up @@ -70,7 +69,7 @@ def std_out_to_dict(stdout_lines, row_key):
# row are arranged in.
fmtd = '{\"' + stdout_line[4:-1].replace('=', '\": ').replace(
', ', ', \"').replace('\"\'', '\'') + "}"
stdout_dict = eval(fmtd)
stdout_dict = eval(fmtd) # pylint: disable=eval-used
output_dict[stdout_dict[row_key]] = stdout_dict
return output_dict

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,6 @@
try:
import onnxruntime as ort
import torch
from onnxruntime.capi.onnxruntime_pybind11_state import InvalidArgument
import tensorflow as tf
import tf2onnx
from tensorflow.keras import layers
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,6 @@

# pylint: disable=ungrouped-imports
try:
from google.api_core.exceptions import BadRequest
from apache_beam.transforms.enrichment import Enrichment
from apache_beam.ml.rag.enrichment.bigquery_vector_search import \
BigQueryVectorSearchEnrichmentHandler
Expand Down
5 changes: 1 addition & 4 deletions sdks/python/apache_beam/runners/pipeline_utils_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -191,10 +191,7 @@ def test_external_merged(self):
# resolved do anything concrete yet.
envs = pipeline_proto.components.environments
self.assertEqual(
len(envs),
2,
f'should be 2 environments, instead got: {envs}'
)
len(envs), 2, f'should be 2 environments, instead got: {envs}')


if __name__ == '__main__':
Expand Down
2 changes: 0 additions & 2 deletions sdks/python/apache_beam/testing/util_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,6 @@
from apache_beam import Create
from apache_beam.options.pipeline_options import StandardOptions
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import BeamAssertException
from apache_beam.testing.util import TestWindowedValue
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
Expand All @@ -40,7 +39,6 @@
from apache_beam.transforms.window import GlobalWindow
from apache_beam.transforms.window import IntervalWindow
from apache_beam.utils.timestamp import MIN_TIMESTAMP
from typing import NamedTuple


class UtilTest(unittest.TestCase):
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,6 @@

import apache_beam as beam
from apache_beam.transforms.window import TimestampedValue
from apache_beam.typehints.decorators import TypeCheckError

T = TypeVar("T")

Expand Down
18 changes: 10 additions & 8 deletions sdks/python/apache_beam/typehints/typecheck_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -174,8 +174,8 @@ class ToInt(beam.DoFn):
def process(self, element, *args, **kwargs):
yield int(element)

with self.assertRaisesRegex(
Exception, "Type-hint for argument: 'element' violated") as e:
with self.assertRaisesRegex(Exception,
"Type-hint for argument: 'element' violated"):
(self.p | beam.Create(['1', '1']) | beam.ParDo(ToInt()))
self.p.run().wait_until_finish()

Expand Down Expand Up @@ -237,8 +237,10 @@ def is_even_as_key(a):

with self.assertRaisesRegex(
Exception,
"Type-hint for return type violated: Tuple\[<class 'bool'>, <class 'int'>\] hint type-constraint violated. The type of element #0 in the passed tuple is incorrect. Expected an instance of type <class 'bool'>, instead received an instance of type int."
):
("Type-hint for return type violated: Tuple\\[<class 'bool'>, <class " +
"'int'>\\] hint type-constraint violated. The type of element #0 in " +
"the passed tuple is incorrect. Expected an instance of type <class " +
"'bool'>, instead received an instance of type int.")):
self.p.run().wait_until_finish()

def test_pipeline_runtime_checking_violation_composite_type_output(self):
Expand All @@ -249,8 +251,8 @@ def test_pipeline_runtime_checking_violation_composite_type_output(self):
# of 'int' will be generated instead.
with self.assertRaisesRegex(
Exception,
"Type-hint for return type violated. Expected an instance of {}, instead found 4.0, an instance of {}."
.format(int, float)):
("Type-hint for return type violated. Expected an instance of {}, " +
"instead found 4.0, an instance of {}.").format(int, float)):
(
self.p
| beam.Create([(1, 3.0)])
Expand Down Expand Up @@ -278,8 +280,8 @@ def process(self, element, *args, **kwargs):
# StrToInt's input type hints were not satisfied while running IntToInt.
with self.assertRaisesRegex(
Exception,
"Type-hint for argument: 'element' violated. Expected an instance of {}, instead found 9, an instance of {}."
.format(str, int)):
("Type-hint for argument: 'element' violated. Expected an instance of "
+ "{}, instead found 9, an instance of {}.").format(str, int)):
(
self.p
| beam.Create([9])
Expand Down
Loading