Commit Graph

141 Commits

Author SHA1 Message Date
Dan 65e62a72e1 These migrations were not runnable from blank state, so cleared out broken code, so someone can still brining up a system. 2022-02-17 15:04:09 -05:00
Dan b72ecb8375 Another re-work to fix 619 - and to assure that we aren't rebuilding the lookup tables too frequently. 2022-02-17 11:59:48 -05:00
Dan eb7760fa55 Adding the migration - very destructive, but required for running the app.
minor fixes - there is still some weird problems with study id and user id being null that I need to track down, but the issue is sporadic, and hard to track down.
2022-02-10 11:50:31 -05:00
Dan ff9b2694ae Fix migrations that depend on removed models. 2022-02-07 11:56:22 -05:00
Dan 5e826ed0cd Adding the migration. 2022-02-02 16:21:45 -05:00
Dan a6dd7a695d The 7225 migration will cause all migrations to fail because it trys to import a service that no longer exists 2022-02-02 16:19:35 -05:00
mike cullerton d82367ab2a Move temp_migration_service code into migration 7225d990740e
Delete test_files_to_filesystem and test_files_from_filesystem--they were only used to give me access to the migration methods
2022-01-26 09:58:46 -05:00
Dan f3637ee6a0 resolving todos, as they are done, and removing commented out code that is no longer in use. 2022-01-25 16:37:17 -05:00
Dan f815add699 1. Add a default directory for the location of SYNC files.
2. Added a last_updated column to the lookup table
3. The Lookup service now uses the above, and compares it to the actual file date, we can then rebuild the lookup if needed.
4. That 755 migration loads up the models, so when you change the models, the migration starts to fail.  Not really sure what to do here, but modify the migration while we are in process.
2022-01-20 13:05:58 -05:00
mike cullerton 31653ec85a delete unused migration 2022-01-19 15:52:36 -05:00
mike cullerton d83f28e1a7 Pushed so Dan can play 2022-01-18 15:55:49 -05:00
mike cullerton 68ac056457 Merge branch 'dev' into files-to-filesystem-572 2022-01-18 08:18:14 -05:00
mike cullerton 6e0bf65093 Prepping for merging current dev.
Will need to change the down revision, and fix the migration
2022-01-18 08:17:36 -05:00
Dan e67a1554ea Always but always but ALWAYS, use server_default=func.now() when setting up a datetime field we autopopulate. 2022-01-12 12:33:59 -05:00
Dan 7176452fe3 forgot the migration, also fixing an error in the TaskLogQuerySchema. 2022-01-10 13:26:16 -05:00
mike cullerton d60ebf9a54 First attempt at changes to LookupFile table
Want to migrate data and modify table
Have to get session through bind
2022-01-06 14:28:20 -05:00
mike cullerton 86a6039dc8 *** WIP ***
**Many** tests are failing!

Committing so I can merge dev into this branch
2022-01-06 11:46:54 -05:00
mike cullerton a44300bd96 More upgrade code - delete associated data for each processed file 2022-01-04 07:24:21 -05:00
mike cullerton 5a46d56158 deleting the file_data records for the processed files 2021-12-17 12:57:28 -05:00
mike cullerton 797f8a2cfc Added another migration to remove slashes from names of files, workflow_specs, and workflow_spec_categories
Changed the order to put it before the existing one.
2021-12-17 11:48:24 -05:00
mike cullerton 5c90ce01a6 *** WIP ***
Temp services `ToFilesystemService` and `FromFilesystemService` for migrating files To and From the filesystem - Not sure where these classes will end up
Tests to call the two services.
upgrade method in migration that writes workflow spec files and metadata to filesystem
2021-12-16 14:22:37 -05:00
mike cullerton 338352017b *** WIP ***
Moving files to the filesystem
Tools for reading/writing metadata for categories and specs
2021-12-16 08:41:49 -05:00
mike cullerton acbb8898e4 Merge branch 'more-study-statuses-562' into waiting-workflow-errors-566 2021-12-10 16:52:07 -05:00
mike cullerton bf21f78085 Seeded progress_status column when status is in_progress 2021-12-10 16:27:17 -05:00
mike cullerton 6d09aa1817 We moved the new statuses to a new column and created a separate enum class for them.
They really are sub_statuses of the in_progress status
2021-12-10 15:57:02 -05:00
mike cullerton 61975093f9 Renamed some files to include the word `progress` 2021-12-10 15:47:34 -05:00
mike cullerton 52baf25459 In `WorkflowService.do_waiting`, if a workflow causes an exception, change its status from `waiting` to `erroring` so we don't continue to call it in `do_waiting`. 2021-12-09 15:33:39 -05:00
mike cullerton ac82187bac We need a migration for the new study statuses 2021-12-09 13:32:21 -05:00
mike cullerton b0c479420d New task_log model with schema, and migration 2021-10-27 12:19:09 -04:00
mike cullerton f1dbda7f95 Fix timestamp field to use (UTC) timezone 2021-10-13 11:46:57 -04:00
mike cullerton 699fc7daac Change column in email table from workflow_id to workflow_spec_id 2021-10-12 13:42:11 -04:00
mike cullerton cdcb3a8bd0 Fixed revision conflict 2021-10-07 12:39:07 -04:00
mike cullerton 24932072dc Merge branch 'dev' into email-data-script-487 2021-10-07 12:30:13 -04:00
mike cullerton 6f93554e7e Migration script for new email columns
!!!This will need to be merged with another migration happening in another ticket concurrently!!!
2021-10-07 09:23:58 -04:00
Dan 4068fbbc08 Migration to fix the names of the workflow specs. 2021-10-06 15:27:26 -04:00
mike cullerton fcf538ca92 remove `name` column from workflow_spec and workflow_spec_category 2021-10-05 13:10:36 -04:00
alicia pritchett d5d4496cd0 Admin flag on category + migration + updated test 2021-09-29 16:53:59 -04:00
mike cullerton 8b8cfde6cb Add `short_name` and `proposal_name` to the study model 2021-09-17 11:53:45 -04:00
mike cullerton 3d7dadc319 Model changes and revision file for task_spec column to file and data_store models 2021-08-26 10:36:10 -04:00
mike cullerton fcebc6ac2b Revision file for DB changes 2021-08-16 13:02:12 -04:00
Kelly McDonald 25319a0e6a Make changes to alembic process - fix test for new API 2021-08-02 08:59:24 -04:00
Kelly McDonald d7c66fb055 fix revisions 2021-07-29 09:41:39 -04:00
Kelly McDonald 41ad7935f8 Merge branch 'dev' into 367-Call-Activity
# Conflicts:
#	Pipfile.lock
2021-07-29 09:28:21 -04:00
Kelly McDonald 2455495457 got library side working - still need to have parent working 2021-07-22 10:20:34 -04:00
Dan 1f0b881b92 Hot patch, merging two heads. 2021-07-12 11:14:31 -04:00
Mike Cullerton 7070761089
Merge pull request #338 from sartography/document-spreadsheet-name-380
Document spreadsheet name #380
2021-07-12 10:11:16 -04:00
mike cullerton 1c9db16bff Migration to change filename from `irb_documents` to `documents` in the database 2021-07-07 13:27:57 -04:00
mike cullerton 23be257db0 Add user_uid column to file_data table 2021-07-06 17:07:47 -04:00
Dan a1bb30e689 Switching from using "default" to "server_default" for all default time settings, and running migrations so that this is set at the database level rather than in python, to hopefully correct some issues with dates being 4 hours in the future. Having a very hard time replicating this issue locally. 2021-05-14 12:28:50 -04:00
Dan 8f28970f92 Resolving an alembic conflict.
Upgrading libraries, and resolving issues from that upgrade, including changes to how we manage tokens.  This seems to be working locally.
2021-05-04 13:39:49 -04:00