Commit Graph

2206 Commits

Author SHA1 Message Date
jasquat 2e1ee93293
Pi migration 2 (#1902)
* added migration detail table along with migration fe page w/ burnettk

* allow specifying bpmn process defintion when getting instance w/ burnettk

* added a test for migration reverting w/ burnettk

* added result states to migration page w/ burnettk

* updated spiffworkflow to fix migration revert issue w/ burnettk

* added test for the migration events api w/ burnettk

* fixed tests

* finished migration web page w/ burnettk

* coderabbit and other issues and added spiffworkflow-local realm and use that if running locally

* fixed pyl issue

* just check for the git revision key in tests instead of a value since the value could be None

* ruff

* updated configs for cypress tests

* use correct realm in ci

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-11 13:46:54 -04:00
burnettk 195aedcf3c
config is defaulted to true in default.py 2024-07-11 12:58:52 -04:00
Stephen Zhang 8f86ff5f84
Support config SQLAlchemy pool_pre_ping option from env (#1883) (#1903)
Co-authored-by: Zhang Cheng <chengzhang@natureself.cn>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-07-11 09:51:49 -07:00
dependabot[bot] 0761505096
Bump types-pytz in /spiffworkflow-backend (#1905)
Bumps [types-pytz](https://github.com/python/typeshed) from 2024.1.0.20240203 to 2024.1.0.20240417.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-pytz
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-11 15:17:28 +00:00
Kevin Burnett 6d16438816
Support jwks rotation (#1900)
* support jwks rotation

* force refresh if not in cache

* cleanup

* dedup

* Update spiffworkflow-backend/src/spiffworkflow_backend/services/authentication_service.py

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

* more types

* lint

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-10 13:00:18 -07:00
pixeebot[bot] 8b26848ec9
Use Safe Parsers in `lxml` Parsing Functions (#1896)
* Use Safe Parsers in `lxml` Parsing Functions

* fix

---------

Co-authored-by: pixeebot[bot] <104101892+pixeebot[bot]@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-07-10 09:37:44 -07:00
dependabot[bot] f80373c822
Bump lxml from 4.9.4 to 5.2.2 in /spiffworkflow-backend (#1899)
Bumps [lxml](https://github.com/lxml/lxml) from 4.9.4 to 5.2.2.
- [Release notes](https://github.com/lxml/lxml/releases)
- [Changelog](https://github.com/lxml/lxml/blob/master/CHANGES.txt)
- [Commits](https://github.com/lxml/lxml/compare/lxml-4.9.4...lxml-5.2.2)

---
updated-dependencies:
- dependency-name: lxml
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-10 15:13:47 +00:00
jasquat ec21ffb735
Pi migration (#1892)
* some initial code to migrate a process instance w/ burnettk essweine

* the migration test is working now w/ burnettk essweine

* use the persist method from the pi migration method w/ burnettk

* updated spiffworkflow w/ burnettk

* added api to migrate a process instance w/ burnettk

* fixed tests w/ burnettk

* added api to check if a process instance can be migrated w/ burnettk

* return error if pi is not suspended when attempting to migrate w/ burnettk

* return error if pi is not suspended when attempting to migrate w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-07-09 14:35:14 -04:00
burnettk 950e288223
use correctly named script 2024-07-08 22:52:59 -04:00
Kevin Burnett e962a0380b
avoid sending MethodNotAllowed to sentry (#1888)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-07-08 08:49:17 -07:00
dependabot[bot] 429692091a
Bump pre-commit-hooks from 4.5.0 to 4.6.0 in /spiffworkflow-backend (#1887)
Bumps [pre-commit-hooks](https://github.com/pre-commit/pre-commit-hooks) from 4.5.0 to 4.6.0.
- [Release notes](https://github.com/pre-commit/pre-commit-hooks/releases)
- [Changelog](https://github.com/pre-commit/pre-commit-hooks/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pre-commit/pre-commit-hooks/compare/v4.5.0...v4.6.0)

---
updated-dependencies:
- dependency-name: pre-commit-hooks
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-08 15:18:41 +00:00
dependabot[bot] f401b1dc0f
Bump types-requests in /spiffworkflow-backend (#1881)
Bumps [types-requests](https://github.com/python/typeshed) from 2.32.0.20240602 to 2.32.0.20240622.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-requests
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-05 15:02:42 +00:00
dependabot[bot] 3de7aafc4b
Bump celery from 5.3.6 to 5.4.0 in /spiffworkflow-backend (#1879)
Bumps [celery](https://github.com/celery/celery) from 5.3.6 to 5.4.0.
- [Release notes](https://github.com/celery/celery/releases)
- [Changelog](https://github.com/celery/celery/blob/main/Changelog.rst)
- [Commits](https://github.com/celery/celery/compare/v5.3.6...v5.4.0)

---
updated-dependencies:
- dependency-name: celery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-07-05 06:38:09 -07:00
burnettk 477ad2134e
fix lint 2024-07-03 16:27:59 -04:00
burnettk d954a5b8ef
detect tasks with multiple incoming flows, related to #1530 2024-07-03 16:23:08 -04:00
dependabot[bot] 3cd172ae85
Bump setuptools from 70.1.1 to 70.2.0 in /spiffworkflow-backend (#1868)
Bumps [setuptools](https://github.com/pypa/setuptools) from 70.1.1 to 70.2.0.
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v70.1.1...v70.2.0)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-03 14:38:47 +00:00
jbirddog 09e2c3b4a9
Leverage `first_task` in `get_ready_engine_steps` (#1858)
* WIP

* Getting pyl to pass

* WIP
2024-07-02 10:01:11 -07:00
Kevin Burnett 3f5290862f
bump spiff for message pre script fix (#1857)
* bump spiff for message pre script fix

* update wish list

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-07-02 09:41:20 -07:00
Kevin Burnett 2f36a70cfb
group metrics by endpoint instead of path (#1856)
* group metrics by endpoint instead of path

* remove unused lint config files

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-07-02 09:03:08 -07:00
jasquat 7dc15fbebb
queue process instances from the apscheduler instead of running them when using celery (#1855)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-02 11:20:29 -04:00
dependabot[bot] d29683bf9e
Bump sqlalchemy from 2.0.27 to 2.0.31 in /spiffworkflow-backend (#1854)
Bumps [sqlalchemy](https://github.com/sqlalchemy/sqlalchemy) from 2.0.27 to 2.0.31.
- [Release notes](https://github.com/sqlalchemy/sqlalchemy/releases)
- [Changelog](https://github.com/sqlalchemy/sqlalchemy/blob/main/CHANGES.rst)
- [Commits](https://github.com/sqlalchemy/sqlalchemy/commits)

---
updated-dependencies:
- dependency-name: sqlalchemy
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-02 15:18:30 +00:00
jasquat 25947a71ab
bp-message-log-improvement (#1850)
* updated logging for messages from the background processor to hopefully make it easier to debug

* minor tweaks to message log

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-02 10:29:21 -04:00
jasquat 352c04f62a
updated SpiffWorkflow for mi task performance improvements w/ burnettk (#1847)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-01 13:32:10 -07:00
jasquat c0e072a2e2
Mi large data debug bpm only (#1846)
* some debug code to help track down slow processing times for mi tasks with larget data sets w/ burnettk

* use mapping cache for task models and bpmn processes and some linting cleanup

* some minor bugfixes w/ burnettk

* assign the correct bpmn process to the given guid w/ burnettk

* fixed data migration tests w/ burnettk

* unit tests are passing w/ burnettk

* integration tets are passing w/ burnettk

* some cleanup while code reviewing w/ burnettk

* some more cleanup w/ burnettk

* pass new args to TaskService in data migration w/ burnettk

* fixed broken test w/ burnettk

* allow running acceptance tests without keycloak w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-01 16:05:51 -04:00
burnettk 6db4ab669f
only create group if not exists 2024-07-01 15:10:18 -04:00
dependabot[bot] cb41f952d6
Bump flask-marshmallow from 1.2.0 to 1.2.1 in /spiffworkflow-backend (#1845)
Bumps [flask-marshmallow](https://github.com/marshmallow-code/flask-marshmallow) from 1.2.0 to 1.2.1.
- [Release notes](https://github.com/marshmallow-code/flask-marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/flask-marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/flask-marshmallow/compare/1.2.0...1.2.1)

---
updated-dependencies:
- dependency-name: flask-marshmallow
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-01 15:21:47 +00:00
Kevin Burnett 30ff5dce08
update security lib for release without stdout (#1840)
* update security for release without stdout

* might as well try to let postgres pass consistently

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-28 09:27:10 -07:00
dependabot[bot] 986a28f5e4
Bump coverage from 7.5.3 to 7.5.4 in /spiffworkflow-backend (#1837)
Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.5.3 to 7.5.4.
- [Release notes](https://github.com/nedbat/coveragepy/releases)
- [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
- [Commits](https://github.com/nedbat/coveragepy/compare/7.5.3...7.5.4)

---
updated-dependencies:
- dependency-name: coverage
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-28 14:31:05 +00:00
jasquat 90216288c5
set-keys-on-message-start (#1835)
* set the correlations on the bpmn process instance when creating a process instance for a message start event w/ burnettk

* downgrade security to avoid unwanted print statements w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-27 13:33:51 -07:00
dependabot[bot] 07b89eaf0f
Bump jsonschema from 4.21.1 to 4.22.0 in /spiffworkflow-backend (#1833)
Bumps [jsonschema](https://github.com/python-jsonschema/jsonschema) from 4.21.1 to 4.22.0.
- [Release notes](https://github.com/python-jsonschema/jsonschema/releases)
- [Changelog](https://github.com/python-jsonschema/jsonschema/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/python-jsonschema/jsonschema/compare/v4.21.1...v4.22.0)

---
updated-dependencies:
- dependency-name: jsonschema
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-27 15:06:18 +00:00
jbirddog e68c626418
Set proccess_instance_id when creating a new thread (#1831) 2024-06-27 10:43:46 -04:00
jasquat bcb124813d
Pi summary field (#1830)
* added summary column to process instance w/ burnettk

* minor fix for summary report w/ burnettk

* force pi summary to 255 characters max w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-26 13:09:06 -07:00
jasquat 1d79d77686
Celery avoid requeueing (#1828)
* some debug code and potential fixes to avoid requeueing future tasks w/ burnettk

* actually insert the queued time into the future task table w/ burnettk

* fixed tests w/ burnettk

* handle missing process instances better from celery worker and updated some comments w/ burnettk

* added comment w/ burnettk

* minor fixes w/ burnettk

* added test for should_schedule_waiting_timer_events w/ burnettk

* added test to ensure we do not queue recently queued tasks again w/ burnettk

* remove traceback code

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-26 10:48:28 -07:00
dependabot[bot] e0b4a48905
Bump setuptools from 69.2.0 to 70.1.1 in /spiffworkflow-backend (#1827)
Bumps [setuptools](https://github.com/pypa/setuptools) from 69.2.0 to 70.1.1.
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v69.2.0...v70.1.1)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-06-26 10:39:55 -07:00
pixeebot[bot] 26149ae339
Sandbox Process Creation (#1799)
* Sandbox Process Creation

* lib already in backend

* update security

* no need to test with newlines, hopefully, since they are not allowed by security lib

* typing things

---------

Co-authored-by: pixeebot[bot] <104101892+pixeebot[bot]@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-25 16:24:41 -07:00
dependabot[bot] 79c9d78f6d
Bump mypy from 1.10.0 to 1.10.1 in /spiffworkflow-backend (#1820)
Bumps [mypy](https://github.com/python/mypy) from 1.10.0 to 1.10.1.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](https://github.com/python/mypy/compare/v1.10.0...v1.10.1)

---
updated-dependencies:
- dependency-name: mypy
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-06-25 14:41:41 -07:00
Kevin Burnett ce6dc339c8
avoid prompt to save if no save button (#1806)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-25 07:36:49 -07:00
jasquat 5e3831f4d6
message-model-perm-check (#1805)
* check if user has permissions to messages before attempting call w/ burnettk

* fixed variable typo w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-24 12:36:07 -07:00
dependabot[bot] 8968d87399
Bump restrictedpython from 7.0 to 7.1 in /spiffworkflow-backend (#1802)
Bumps [restrictedpython](https://github.com/zopefoundation/RestrictedPython) from 7.0 to 7.1.
- [Changelog](https://github.com/zopefoundation/RestrictedPython/blob/master/CHANGES.rst)
- [Commits](https://github.com/zopefoundation/RestrictedPython/compare/7.0...7.1)

---
updated-dependencies:
- dependency-name: restrictedpython
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-24 14:38:44 +00:00
jasquat d2e005022b
use the greedy strategy when running messages from the background processor w/ burnettk (#1798)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-21 16:22:42 -04:00
Kevin Burnett 6ab89dab40
default to local openid instead of keycloak container dependency (#1794)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-21 08:38:52 -07:00
dependabot[bot] 0f7113486c
Bump typing-extensions from 4.10.0 to 4.12.2 in /spiffworkflow-backend (#1788)
Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.10.0 to 4.12.2.
- [Release notes](https://github.com/python/typing_extensions/releases)
- [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md)
- [Commits](https://github.com/python/typing_extensions/compare/4.10.0...4.12.2)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-21 14:42:17 +00:00
jasquat 4dbcd8a655
improved-celery-logging (#1785)
* updated logging for celery workers w/ burnettk

* fixed indentation error

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-21 09:51:36 -04:00
burnettk 278fa239f4
poet lock no update 2024-06-20 15:44:00 -04:00
jasquat eed946260c
Test migration change (#1784)
* added tests to ensure migrations do not change w/ burnettk

* fixed tests w/ burnettk

* pyl w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-20 12:38:59 -07:00
Kevin Burnett 0f31260570
Scrap openai lib (#1782)
* scrap openai lib

* iterate

* bring down temperature and top_p

* remove lib

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-20 11:58:00 -07:00
burnettk 49c1584b9c
bump requests to fix safety 2024-06-20 14:46:21 -04:00
dependabot[bot] 79bef27b3b
Bump safety from 3.2.1 to 3.2.3 in /spiffworkflow-backend (#1780)
Bumps [safety](https://github.com/pyupio/safety) from 3.2.1 to 3.2.3.
- [Release notes](https://github.com/pyupio/safety/releases)
- [Changelog](https://github.com/pyupio/safety/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pyupio/safety/compare/3.2.1...3.2.3)

---
updated-dependencies:
- dependency-name: safety
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-06-20 11:42:59 -07:00
jasquat c050d194dc
Merge branch 'main' of github.com:sartography/spiff-arena 2024-06-20 13:39:12 -04:00
jasquat b62da219df
updated serializer version to reflect version 5 data migration 2024-06-20 13:39:08 -04:00