sqlfluff/sqlfluff 1.4.0

[1.4.0] - 2022-10-31

on GitHub

This release brings several internal changes, and acts as a prelude to 2.0.0 which will be released fairly soon. In particular, the following config values have changed:

• sqlfluff:rules:L007:operator_new_lines has been changed to sqlfluff:layout:type:binary_operator:line_position.
• sqlfluff:rules:comma_style and sqlfluff:rules:L019:comma_style have both been consolidated into sqlfluff:layout:type:comma:line_position.

If any of these values have been set in your config, they will be automatically translated to the new values at runtime, and a warning will be shown. To silence the warning, update your config file to the new values. For more details on configuring layout (including some changes yet to come in future versions) see the docs.

These changes are driven by underlying centralisation in the routines which control layout. While for this release, no breaking changes are expected - you may find slight differences in how SQLFluff handles edge cases. We believe in the majority of cases these are more consistent, but if you find any which are problematic then do post an issue on GitHub as usual.

Other highlights from this release:

• Better dbt supportfor graph nodes and avoiding dependency conflicts.
• Numerous dialect improvements to T-SQL, MySQL, SparkSQL, SQLite, Athena Snowflake, Hive, Postgres & Databricks.

There have also been first time contributions from 10 new contributors! 🎉🎉🎉

What’s Changed

• Prep version 1.4.0 (#3983) @github-actions
• Snowflake partition nonreserved keyword (#3972) @YilangHe
• Hive: Add support for EXCHANGE PARTITION in ALTER TABLE (#3991) @nahuelverdugo
• Resolve parse error on multiple bracketed statements (#3994) @yoichi
• Enable parsing of CLONE keyword in bigquery dialect (#3984) @realLyans
• BigQuery: allow nesting of SetExpressionSegment (#3990) @yoichi
• feat(clickhouse): Support non-standard CREATE TABLE statement (#3986) @tomasfarias
• Fix Windows CI check (#3992) @greg-finley
• Snowflake tag reference segment (#3985) @WittierDinosaur
• Fix Jinja templater issue where undefined callable threw an exception (#3982) @barrywhart
• Reflow Documentation V1 (#3970) @alanmcruickshank
• Allow lambda argument columns to be unqualified (#3971) @olagjo
• document inline configuration (#3981) @alanmcruickshank
• [BUGFIX] Changing cwd temporarily on manifest load as dbt is not using project_dir to read/write target folder (#3979) @barrywhart
• Fix type annotation of user_rules in Linter (#3977) @Samyak2
• Unpin markupsafe (#3967) @judahrand
• Snowflake frame clause variables (#3969) @WittierDinosaur
• SparkSQL: added support for : (colon sign) operator (Databricks SQL) (#3956) @karabulute
• Athena: Add support for using underscore aliases (#3965) @hectcastro
• Snowflake: ALTER TABLE constraint actions (#3959) @erevear
• MySQL: Support REPLACE statement (#3964) @yoichi
• TSQL: Add support for UPDATE STATISTICS option FULLSCAN (#3950) @hectcastro
• ANSI: fixed typos in docstrings and comments (#3953) @karabulute
• Postgres: ALTER PROCEDURE (#3949) @krokofant
• T-SQL: Allow arbitrary expressions in PARTITION BY clause (#3939) @borchero
• Enable dumping of performance information to csv. (#3937) @alanmcruickshank
• Consolidate comma style configs (#3945) @alanmcruickshank
• Adding missing KeywordSegments for different file types in Athena dialect (#3898) @CommonCrisis
• Add templated block uuids (#3936) @alanmcruickshank
• Load the full dbt manifest (#3926) @davajm
• MySQL: Support optional "IF NOT EXISTS" with CREATE TRIGGER (#3943) @yoichi
• T-SQL: Allow to parse SYNONYM statements (#3941) @borchero
• Hive: Add support for LATERAL VIEW clause (#3935) @hectcastro
• Fix crash in L042 on "UNION" or other "set" queries (#3931) @barrywhart
• Refactor Lexer: Split apart elements_to_segments and refine placement of meta segments. (#3925) @alanmcruickshank
• Add INSERT INTO <> DEFAULT VALUES to ANSI SQL and T-SQL (#3934) @borchero
• Break apart reflow classes and extract methods (#3919) @alanmcruickshank
• T-SQL: Fix indendentation of OUTER APPLY (#3932) @borchero
• MySQL: Fix create trigger (#3928) @adam-tokarski
• SparkSQL: Fixed bug with QUALIFY usage without WHERE clause (applies also for Databricks dialect) (#3930) @karabulute
• T-SQL: Allow specifying join hints (#3921) @borchero
• SQLite: Add support for table-level CHECK constraint (#3923) @hectcastro
• sparksql: added * EXCEPT for SELECT clause (#3922) @adam-tokarski
• Map old configs to new configs (#3915) @alanmcruickshank
• [issue_3794] allow to use 'usage' as identifier for postgres (#3914) @adam-tokarski
• DATABRICKS: Add Support for Delta Live Tables (DLT) Syntax (#3899) @R7L208
• Postgres Revoke fix (#3912) @greg-finley
• fix: Click output to stderr on errors (#3902) @KingMichaelPark
• fix issue with empty enum for postgres (#3910) @adam-tokarski
• feat: Optional numerics for postgres arrays (#3903) @KingMichaelPark
• fix(test): Return ParseExample namedtuple in get_parse_fixtures (#3911) @tomasfarias
• Fix typos (#3901) @kianmeng
• provide custom DeprecatedOption (#3904) @adam-tokarski
• fix(redshift): Allow keywords in qualified references (#3905) @tomasfarias
• Reflow centralisation 2: Rebreak (operators & commas) (#3847) @alanmcruickshank
• Bring L008 into reflow work (#3908) @alanmcruickshank
• Snowflake: Create network policy ip lists (#3888) @greg-finley
• MySQL: Implement (key_part, ...) in index definitions (#3887) @yoichi
• Reflow centralisation 1: Scope + Respace (#3824) @alanmcruickshank
• Update github badge and add docker badge (#3884) @alanmcruickshank