DAG refactors for Airflow upgrade

What's Changed

• BL-1708 Import pendulum in all dags by @sensei100 in #925
• BL-1708 Use pendulum.now() instead of data_interval_start by @sensei100 in #926
• Update schedule to weekly by @sensei100 in #929
• BL-1707: Fix wrong permission in created sftp folder. by @dkinzer in #932
• Bump boto3 from 1.24.89 to 1.25.5 by @dependabot in #924
• Update python dependencies by @sensei100 in #970
• Bump airflow-docker-dev-setup from ec633b0 to fcaab77 by @dependabot in #972

Full Changelog: v2.0.2...v2.1.0

Update deployment process

What's Changed

• Bump airflow-docker-dev-setup from be23740 to bdfae3e by @dependabot in #891
• Update airflow version due to security vulnerability by @sensei100 in #906
• Bump airflow-docker-dev-setup from bdfae3e to ec633b0 by @dependabot in #909
• Try to only deploy dag-related tasks by @sensei100 in #910
• Bump apache-airflow from 2.4.1 to 2.4.2 by @dependabot in #916

Full Changelog: v2.0.1...v2.0.2

Fix Space dag

What's Changed

• Bump apache-airflow from 2.3.2 to 2.3.3 by @dependabot in #798
• Bump numpy from 1.23.0 to 1.23.2 by @dependabot in #840
• DEVO-601 Fix broken DSpace dag by @sensei100 in #889
• Bump boto3 from 1.24.79 to 1.24.81 by @dependabot in #890

Full Changelog: v2.0.0...v2.0.1

Airflow 2 updates

What's Changed

• Upgrade to airflow==2.3.0 by @dkinzer in #739
• Devo 568 catalog reindex fix by @sensei100 in #753
• Try adding config tasks to qa_deploy by @sensei100 in #754
• Add the airflow tag by @sensei100 in #755
• DEVO-571 Fix deprecation warnings by @sensei100 in #756
• Updates variables.json to add more by default by @sensei100 in #760
• DEVO-569-datetime-updates by @sensei100 in #770
• Bump airflow-docker-dev-setup from d75779f to be23740 by @dependabot in #765
• Add importlib_metadata due to circleCI failures by @sensei100 in #789
• Update airflow due to conflicts with constraints by @sensei100 in #790
• Bump boto3 from 1.24.21 to 1.24.26 by @dependabot in #799
• Run the airflow role for prod_deploy by @sensei100 in #802

Full Changelog: v1.7.4...v2.0.0

Add boundwith DAG

What's Changed

• Bump tulflow from 0.8.2 to 0.8.4 by @dependabot in #630
• Bump pytest from 6.2.4 to 6.2.5 by @dependabot in #541
• Bump pylint from 2.12.1 to 2.12.2 by @dependabot in #627
• Bump setuptools from 59.4.0 to 59.6.0 by @dependabot in #635
• Bump moto from 2.2.17 to 2.2.19 by @dependabot in #637
• Bump lxml from 4.6.3 to 4.7.1 by @dependabot in #638
• Bump boto3 from 1.20.18 to 1.20.24 by @dependabot in #636
• Bump airflow-docker-dev-setup from bfbc699 to 4b2e308 by @dependabot in #642
• Bump moto from 2.2.19 to 2.3.0 by @dependabot in #653
• Bump airflow-docker-dev-setup from 4b2e308 to d75779f by @dependabot in #647
• Bump boto3 from 1.20.24 to 1.20.26 by @dependabot in #646
• DEVO-360 airflow 2 updates by @sensei100 in #524
• DEVO-362 Airflow 2 updates by @sensei100 in #663
• DEVO-362 Additional arg updates by @sensei100 in #664
• BL-1609: remove tag from transform by @htomren in #666
• Revert "BL-1609: remove tag from transform" by @sensei100 in #670
• Bump tulflow from 0.8.5 to 0.8.6 by @dependabot in #665
• Bump paramiko from 2.9.1 to 2.9.2 by @dependabot in #660
• Fix inaccurate file comment. by @dkinzer in #702
• BL-1634: Refactor catalog_full_reindex_dag. by @dkinzer in #703
• Need to make these changes to make it work in the m1 mac. by @dkinzer in #699
• BL-1633: Add dag to move boundwith files. by @dkinzer in #701
• BL-1633: Fix task not saving correct namespace. by @dkinzer in #709
• BL-1635: Update full reindexing doc. by @dkinzer in #704
• Remove unnecessary full reindexing steps. by @dkinzer in #710
• Bl 1609 remove outer collection params by @dkinzer in #711
• BL-1609 update transform by @htomren in #712
• BL-1609 update transform (again) by @htomren in #713
• BL-1634: Update bw path to use correct folder. by @dkinzer in #714

Full Changelog: v1.7.3...v1.7.4

CircleCI updates

What's Changed

• DEVO-478 Update circleci image by @sensei100 in #623

Full Changelog: v1.7.2...v1.7.3

Fix az and web content indexing (v1.7.2)

What's Changed

• Bump airflow-docker-dev-setup from b907a9d to bfbc699 by @dependabot in #431
• Update the number of retries for verify_collection task by @sensei100 in #441
• Always enforce utf-8 encoding. by @dkinzer in #442
• Add another step to deployment process by @sensei100 in #466
• Bump lxml from 4.6.2 to 4.6.3 by @dependabot in #418
• Bump apache-airflow from 1.10.14 to 1.10.15 by @dependabot in #428
• Bump requests-mock from 1.9.2 to 1.9.3 by @dependabot in #448
• Bump tulflow from 0.8.0 to 0.8.2 by @dependabot in #468
• Bump pylint from 2.8.2 to 2.9.6 by @dependabot in #508
• Bump boto3 from 1.17.69 to 1.18.19 by @dependabot in #521
• DEVO-417: revert use execution_date for collection name. by @dkinzer in #514
• BL-1566: Fix web content, az index broken after lets encrypt. by @dkinzer in #571

Full Changelog: v1.7.1...v1.7.2

Handle slow Manifold Response

Extends read timeout time for slow responding Manifold response due to large JSON content.

DSPACE new SFTP

• Use new DSPACE sftp endpoint
• Cleanup dags.

Replication Factor Release (v1.6.0)

Merge pull request #334 from tulibraries/xslt-orcid

update ORCID mapping