5.0.0-alpha

New Feature

1. The pluggable architecture is available and support function extension through the SPI.
2. Independent SQL parsing engine is available to get SQL parsed AST for the different database dialects.
3. New RDL feature for ShardingSphere Proxy supports creating sharding rules and sharding tables.
4. ShardingSphere-Scaling supports resuming data migration from break-point.
5. ShardingSphere-Scaling supports using ShardingSphere JDBC to migrate data to new cluster.
6. ShardingSphere shadow database is available.

API Changes

1. New sharding/encryption/shadow/queryReplica API.
2. New sharding algorithm and strategy API.
3. New API for ShardingSphere Scaling to create task.
4. Remove DefaultDataSourceName setting item.
5. The separator of the parameter configuration item is changed from - the dot ‘.’ to minus sign ‘-’.
6. Change parameter allow.range.query.with.inline.sharding from global parameter to sharding algorithm parameter.

Refactor

1. Refactor the architecture of SQL parsing module base on the database dialects.
2. Use SPI mechanism to reconstruct online metadata change processing.
3. Rename Orchestration module to Governance module.
4. Rename MasterSlave module to QueryReplica module.
5. Refactor the metadata structure in the governance registration center.
6. Refactor GovernmentShardingSphereDataSource.
7. ShardingSphere UI merges configuration center and registration center display layout.

Enhancement

1. Upgrade the minimum supported version of JDK to Java8.
2. Update Zookeeper curator to version 5.1.0.
3. Update Google Guava to version 29.0-jre.
4. The enhancement for MySQL SQL syntax definition and parsing process.
5. The enhancement for PostgreSQL syntax definition and parsing process.
6. The enhancement for sub-queries in different database dialects.
7. Support MySQL view operations for non-sharding tables
8. Support MySQL stored functions and procedure operations for non-sharding tables.
9. Support SQLServer Top syntax.
10. Optimize the metadata loading to improve the startup speed.
11. Optimize batch insert performance.
12. Supports the use of Oracle RAC JDBC URL.
13. XA transaction manager adds support for Oracle database.
14. ShardingSphere Proxy supports the use of p6sy driver.
15. Add help information to the ShardingSphere Proxy startup script.

Bug fixes

1. Fix alias rewriting error when processing OrderBy condition.
2. Fix SQL rewriting error when MYSQL Insert statement contains expression.
3. Fix parameter calculation error in update on duplicate SQL.
4. Fix generatedKeys gets wrong when batch inserting.
5. Fix the abnormal issue of multi-table verification in DML statement update operation.
6. Fix the NPE problem caused by executing SQL when the table does not exist.
7. Fix the exception when using the Show table command for an unconfigured table.
8. Fix metadata loading error when Oracle database has multiple qualified users.
9. Fix the issue that replica node cannot be enabled online.
10. Fix the problem that ShardingSphere-JDBC does not support PostgreSQL array type.
11. Fix the problem that ShardingSphere-Proxy does not respond when querying long blob data.

4.1.1

Enhancement

1. Add Sharding-UI dockerfile
2. Enhancement for Sharding-UI docker build

Bug Fixes

1. Fix faild to disable slave database through ui

4.1.1

Enhancement

1. Add Sharding-Scaling & Sharding-UI dockerfile
2. update MySQL & PostgreSQL version for proxy

Bug Fixes

1. Fix parser syntax rule of SUBSTRING and CONVERT
2. Fix parser ColumnSegment ClassCastException
3. Fix TableMetaData load error when use Sharding-JDBC with oracle
4. Fix getSchema NPE when use Sharding-JDBC with oracle
5. Fix Sharding-JDBC parse sql NPE in PostgreSQL
6. Fix Sharding-Proxy receive error response for PostgreSQL JDBC client
7. Fix Sharding-Proxy response number of update is 0 for PostgreSQL JDBC client
8. Fix Sharding-Proxy receive null for PostgreSQL column meta data
9. Fix Sharding-Scaling NPE in MySQL incremental task

Change Logs

1. MILESTONE

4.1.0

New Features

1. Add a start.bat to launch for shardingsphere-ui distribution module in Windows
2. The work flow and roadmap of sharding-scaling

Enhancements

1. sharding-ui-frontend config file problem
2. The enhancement for the first version sharding-scaling-ui
3. Fix link of build status
4. Fix ui login Chinese text
5. Add sharding scaling API document

Bug Fixes

1. Fix request error page interactive presentation problem
2. Fix ui module for new center api
3. Fix spelling error
4. UI details modification
5. Fixes ui errors when loading datasources config

4.1.0

New Features

1. Support scaling for ShardingSphere (alpha version)
2. Move etcd registry center from experiment repo to apache repo
3. Upgrade to Java 8

Enhancement

1. Optimization for Sharing Parser with ANTLR Visitor improving the parsing performance of long SQL by 100%~1000%
2. Use multiple threads to load metadata for different data sources
3. Support allow.range.query.with.inline.sharding option
4. The docker of Sharding-Proxy supports loading external lib packages
5. Support integration with Spring using @ShardingTransactionType
6. Enhance ShardingDataSource to compatiable with Seata in micro-sevice distribution transaction

Refactor

1. Remove leaf key generator

Bug Fixes

1. Fix an exception caused by using a CHAR/VARCHAR type column as a order by item
2. Refine DataTypeName syntax rules of all database dialects
3. Fix an exception caused by executing BEGIN using prepared statement of MySQL C API
4. Fix the problem that ALTER TABLE fails to execute when the field type of the table contains Integer/Double/BigDecimal
5. Fix the problem of the stop index dislocation of segment with alias
6. Fix the problem that overwriting SQL SELECT * FROM tbl WHERE encrypt_col = ? AND (sharding_key = ? OR sharding_key = ?) when using sharding + encrypt would throw StringIndexOutOfBoundsException
7. Fix the problem of incorrect decoding after AES encoding when using Sharding-Proxy in Spring Boot
8. Fix a long-time problem of adding schema dynamically in Sharding-UI

Change Logs

1. MILESTONE

4.0.1

Bug Fixes

1. Using guava cache to fix parsing deadlock.
2. Oracle insert SQL could not work in encrypt mode.
3. Proxy for PostgreSQL decode parameters error in all types except String.
4. COM_STM_EXECUTE of proxy for MySQL could not support sysbench.
5. None sharding strategy could not config in spring-boot.
6. Plain column could not get from resultSet in sharding-encrypt mode.
7. WasNull field was wrong in GroupByStreamMergeResult.
8. Metadata.getColumns could not work in JDBC.
9. IN operator contains space and \n \t \r could not supported by parser.

Enhancement

1. Optimize antlr performance using two-stage parsing strategy.
2. Add class filter constructor to restrict the illegal class from YAML.

Change Logs

1. MILESTONE

4.0.0

API Changes

1. Change package and maven groupId form io.shardingsphere to org.apache.shardingsphere.
2. Adjust Sharding-JDBC configuration API.
3. Adjust persist structure for registry center.

New Features

1. SQL92 Syntax available.
2. Sharding-Proxy for PostgreSQL protocol available.
3. SQL 100% compatible if route to single data node.
4. Less-than(<), greater-than(>) and Less-than-equal(<=), greater-than-equal(>=) for sharding key operator available.
5. DISTINCT SQL syntax available.
6. Broadcast table available.
7. LEAF key generator available.
8. XA Transaction available, Atomikos, Narayana and Bitronix integrated.
9. BASE Transaction available, Seata integrated.
10. Data encrypt available.
11. Skywalking plugin available.
12. Sharding-UI available, an orchestration management platform.

Enhancement

1. MariaDB supported.
2. Improve the compatibility of SQL parsing.
3. SELECT FOR UPDATE route to master data source only.
4. Hint in Sharding-Proxy available.
5. Make configuration of orchestration consistent between Sharding-JDBC and Sharding-Proxy.
6. Renew modified data sources only, not renew all the data sources.
7. Vibrate configurable for Snowflake key generator.

Bug Fixes

1. Improve the compatibility of JDBC Driver URL.
2. Delete statement with alias available.
3. Check and disable updating sharding column.
4. Fix wrong type of TINYINT and SMALLINT as INTEGER.

Change Logs

1. MILESTONE #3
2. MILESTONE #4
3. MILESTONE #5
4. MILESTONE #6
5. MILESTONE #7
6. MILESTONE #8
7. MILESTONE #9

4.0.0-RC3

New Features

1. Sharding-UI, an orchestration management platform for ShardingSphere comes online.
2. Not only SQLs from MySQL, PostgreSQL, SQLServer, Oracle, but any SQL92 Syntax can be parsed correctly and used in ShardingSphere.

Enhancement

1. Support using less-than character(<) and greater-than character(>) for sharding data.
2. When master and slave dataSources exist, support executing SELECT FOR UPDATE on master dataSource.
3. Support hint in Sharding-Proxy.
4. Finish parsing DAL syntax for MySQL.
5. Make configuration of orchestration compatible between Sharding-JDBC and Sharding-Proxy.

Bug Fixes

1. Through Bug fix, the feature of encryption becomes much stable and applicable.
2. Support delete statement with alias.
3. Check and disable updating sharding column.
4. Fix wrong type of TINYINT and SMALLINT as INTEGER.

Refactor

1. Rename optimized module to preprocessor module.
2. Decouple rewrite core module for sharding/encrypt features.

Change Logs

1. MILESTONE

4.0.0.RC2

API Changes

1. Optimize and delete API and configuration item of sharding logic index.
2. Update the API of encryption to support the encrypted and plain data coexistence.

New Features

1. Integration of Seata for distributed transaction.
2. User can do data encryption by using ShardingProxy.
3. User can use Leaf-segment generator to get distributed ID.
4. Support Skywalking plugin for application performance management.

Enhancement

1. Renew modified dataSources, not all the datasources to improve performance for configuration orchestration.
2. Improve the compatibility of SQL parsing.

Refactor

1. Remove DatabaseType enum, use dynamic SPI to load data source type.
2. The parse engine upgrade from the 2nd generation to 3rd.
3. The Refactoring of SQL rewriting module.

Change Logs

1. MILESTONE

Merge all change logs of version 3.1.0.M1, 3.1.0, 3.1.0.1 and 4.0.0.M1. First apache release.

API Changes

1. Adjust persist structure for orchestration's registry center.
2. Adjust Sharding-JDBC configuration API.
3. Change package and maven groupId form io.shardingsphere to org.apache.shardingsphere.
4. Adjust spring-boot-starter.

New Features

1. XA Transaction available.
2. Data encrypt available.
3. Use PostgreSQL protocol access Sharding-Proxy available.
4. DISTINCT SQL syntax available.
5. Broadcast table.
6. All SQL 100% compatible if route to single data node (MySQL Only).

Change Logs

1. MILESTONE #3
2. MILESTONE #4
3. MILESTONE #5
4. MILESTONE #6

Milestones

1. Sharding-Proxy launch. Support the use of Sharding-Sphere in the form of database to support for MySQL CLI and GUI client

New Features

Core

1. ISSUE #290 Support batch INSERT
2. ISSUE #501 Support OR
3. ISSUE #980 Support DCL
4. ISSUE #1111 Support MySQL DAL

Sharding-Proxy

1. ISSUE #902 Support XA transaction
2. ISSUE #916 Support authorization
3. ISSUE #936 Support registry center
4. ISSUE #1046 Support multiple logic databases

Enhancements

Core

1. ISSUE #373 Support order by ?
2. ISSUE #610 Route unicast for DQL without table
3. ISSUE #701 Caching parsed results to improve performance
4. ISSUE #773 Support sharding and autoincrement key of INSERT without column names
5. ISSUE #935 Use YAML instead of JSON to store configurations in registry center
6. ISSUE #1004 Properties can configure for Sharding and Master-slave independent
7. ISSUE #1205 Execute engine enhancement

Sharding-JDBC

1. ISSUE #652 Support Spring Boot Starter 2.X
2. ISSUE #702 Support $->{..} for inline expression
3. ISSUE #719 Support inject key generator objects by spring namespace
4. ISSUE #720 Support inject sharding algorithm objects by spring namespace

Sharding-Opentracing

1. ISSUE #1172 Opentracing enhancement

API changes

1. ISSUE #1153 Adjust the maven artifactId for Orchestration module
2. ISSUE #1203 Adjust Spring namespace xsd for Sharding and Master-slave
3. ISSUE #1289 Adjust Hint API
4. ISSUE #1302 Refine package structure
5. ISSUE #1305 Deprecated and remove sharding-jdbc-transaction-parent module
6. ISSUE #1382 Remove type configuration in Orchestration module

Bug Fixes

Core

1. ISSUE #569 Failed to parse SQL for Oracle when ROWNUM is not at end
2. ISSUE #628 Support data type jsonb for PostgreSQL
3. ISSUE #646 When aliases in SELECT ITEMS correspond to the real column names of GROUP BY or ORDER BY, there is no need to generate derived columns
4. ISSUE #806 NOT IN parse exception
5. ISSUE #827 Endless loop for bad SQL like SELECT * FROM table WHERE id IN ()
6. ISSUE #919 Inline expression with groovy may cause memory leak
7. ISSUE #993 Fail to parsing PostgreSQL due to the quotation
8. ISSUE #1015 Support SQL like SELECT id, COUNT(*) FROM table GROUP BY 1,2
9. ISSUE #1120 Derived columns of GROUP BY / ORDER BY appear in query result
10. ISSUE #1186 Dead lock may occur on MEMORY_STRICTLY mode when get connection on concurrency environment
11. ISSUE #1265 RoundRobinMasterSlaveLoadBalanceAlgorithm throw an ArrayIndexOutOfBoundsException when AtomicInteger overflow

Sharding-JDBC

1. ISSUE #372 Reuse PreparedStatement cause cache of route result do not clean
2. ISSUE #629 Support transaction isolation on JDBC
3. ISSUE #735 Unexpected slave datasource routing result when using Round-robin load-balance algorithm in Mybatis
4. ISSUE #1011 Can't resolve placeholder in Spring Boot YAML configuration

API Changes

1. Adjust persist structure for orchestration's registry center.
2. Adjust Sharding-JDBC configuration API.

New Features

1. XA Transaction available.
2. All SQL 100% compatible if route to single data node (MySQL Only).
3. DISTINCT SQL syntax available.
4. Broadcast table available.
5. Solve data lean problem when using DefaultKeyGenerator with low TPS.

Change Logs

1. MILESTONE #3
2. MILESTONE #4

API changes

1. Adjust persist structure for orchestration's registry center.
2. Adjust Sharding-JDBC configuration API.

New Features

1. XA Transaction available.
2. All SQL 100% compatible if route to single data node (MySQL Only).
3. DISTINCT SQL syntax available.
4. Broadcast table available.
5. Solve data lean problem when using DefaultKeyGenerator with low TPS.

Change Logs for Issues and Pull requests

Milestones

1. Sharding-Proxy launch. Support the use of Sharding-Sphere in the form of database to support for MySQL CLI and GUI client

New Features

Core

1. ISSUE #290 Support batch INSERT
2. ISSUE #501 Support OR
3. ISSUE #980 Support DCL
4. ISSUE #1111 Support MySQL DAL

Sharding-Proxy

1. ISSUE #902 Support XA transaction
2. ISSUE #916 Support authorization
3. ISSUE #936 Support registry center
4. ISSUE #1046 Support multiple logic databases

Enhancements

Core

1. ISSUE #373 Support order by ?
2. ISSUE #610 Route unicast for DQL without table
3. ISSUE #701 Caching parsed results to improve performance
4. ISSUE #773 Support sharding and autoincrement key of INSERT without column names
5. ISSUE #935 Use YAML instead of JSON to store configurations in registry center
6. ISSUE #1004 Properties can configure for Sharding and Master-slave independent
7. ISSUE #1205 Execute engine enhancement

Sharding-JDBC

1. ISSUE #652 Support Spring Boot Starter 2.X
2. ISSUE #702 Support $->{..} for inline expression
3. ISSUE #719 Support inject key generator objects by spring namespace
4. ISSUE #720 Support inject sharding algorithm objects by spring namespace

Sharding-Opentracing

1. ISSUE #1172 Opentracing enhancement

API changes

1. ISSUE #1153 Adjust the maven artifactId for Orchestration module
2. ISSUE #1203 Adjust Spring namespace xsd for Sharding and Master-slave
3. ISSUE #1289 Adjust Hint API
4. ISSUE #1302 Refine package structure
5. ISSUE #1305 Deprecated and remove sharding-jdbc-transaction-parent module
6. ISSUE #1382 Remove type configuration in Orchestration module

Bug Fixes

Core

1. ISSUE #569 Failed to parse SQL for Oracle when ROWNUM is not at end
2. ISSUE #628 Support data type jsonb for PostgreSQL
3. ISSUE #646 When aliases in SELECT ITEMS correspond to the real column names of GROUP BY or ORDER BY, there is no need to generate derived columns
4. ISSUE #806 NOT IN parse exception
5. ISSUE #827 Endless loop for bad SQL like SELECT * FROM table WHERE id IN ()
6. ISSUE #919 Inline expression with groovy may cause memory leak
7. ISSUE #993 Fail to parsing PostgreSQL due to the quotation
8. ISSUE #1015 Support SQL like SELECT id, COUNT(*) FROM table GROUP BY 1,2
9. ISSUE #1120 Derived columns of GROUP BY / ORDER BY appear in query result
10. ISSUE #1186 Dead lock may occur on MEMORY_STRICTLY mode when get connection on concurrency environment
11. ISSUE #1265 RoundRobinMasterSlaveLoadBalanceAlgorithm throw an ArrayIndexOutOfBoundsException when AtomicInteger overflow

Sharding-JDBC

1. ISSUE #372 Reuse PreparedStatement cause cache of route result do not clean
2. ISSUE #629 Support transaction isolation on JDBC
3. ISSUE #735 Unexpected slave datasource routing result when using Round-robin load-balance algorithm in Mybatis
4. ISSUE #1011 Can't resolve placeholder in Spring Boot YAML configuration

New Features

Core

1. ISSUE #980 Support DCL

Sharding-Proxy

1. ISSUE #916 Support authorization
2. ISSUE #936 Support registry center

Enhancements

Core

1. ISSUE #935 Use YAML instead of JSON to store configurations in registry center
2. ISSUE #1004 Properties can configure for Sharding and Master-slave independent

Bug Fixes

Core

1. ISSUE #919 Inline expression with groovy may cause memory leak
2. ISSUE #1015 Support SQL like SELECT id, COUNT(*) FROM table GROUP BY 1,2

Sharding-JDBC

1. ISSUE #372 Reuse PreparedStatement cause cache of route result do not clean
2. ISSUE #993 Fail to parsing PostgreSQL due to the quotation
3. ISSUE #1011 Can't resolve placeholder in Spring Boot YAML configuration

Milestones

1. Sharding-Proxy launch. Support the use of Sharding-Sphere in the form of database to support for MySQL CLI and GUI client

New Features

1. ISSUE #290 Support batch INSERT statements
2. ISSUE #501 Support OR statement

Enhancements

1. ISSUE #608 Support the USE statement of MySQL
2. ISSUE #609 Support the SHOW statement of MySQL
3. ISSUE #610 Optimize the DQL that does not contain a table name
4. ISSUE #611 Support the DESC statement of MySQL
5. ISSUE #652 Support Spring Boot Starter 2.x
6. ISSUE #701 Support caching parsing results of SQL to improve performance
7. ISSUE #702 Support $->{..} as mark for inline expression
8. ISSUE #719 Support Spring bean namespace to inject key generator objects
9. ISSUE #720 Support Spring bean namespace to inject sharding algorithm objects
10. ISSUE #773 Support sharding and autoincrement primary key of INSERT statements without column names

Bug Fixes

1. ISSUE #628 Support data type jsonb for PostgreSQL
2. ISSUE #629 Support transaction isolation on JDBC
3. ISSUE #646 When aliases in SELECT ITEMS correspond to the real column names of GROUP BY or ORDER BY, there is no need to add columns
4. ISSUE #735 Unexpected slave datasource routing result when using Round-robin load-balance algorithm in Mybatis
5. ISSUE #806 SQL parse error with NOT IN
6. ISSUE #827 Fix endless loop for bad SQL like SELECT * FROM table WHERE id IN ()

功能提升

1. ISSUE #600 支持TCL

缺陷修正

1. ISSUE #522 读写分离Slave库不需要执行DDL语句
2. ISSUE #540 梳理并支持别名为关键字SQL
3. ISSUE #577 支持YAML配置换行