FASTER - 来自Microsoft Research的一个快速、并发的键值KV存储
FASTER，一个新的并发键值存储，专为点查找和大量更新而设计。通过利用快速外部存储，FASTER支持大于内存的数据。 FASTER与众不同之处在于其高速缓存优化索引可实现非常高的性能 - 当数据适合内存时，每秒可高达1.6亿次操作;Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at:
- https://www.nuget.org/packages/Microsoft.FASTER.Core
- https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
More information at:
Changes:
- d879a88 * Capture exceptions during ReadAsync and RMWAsync await to be processed during Complete() (#356)
- fb26daf [C#] Support Memory keys and values out of the box (#354)
- 1f8febe [C#] Update debug assert condition for state machine to take into account that index-only checkpoints do not increment the checkpoint version number.
- 50d13ae [C#] Fixing SpanByte copy to zero-fill rest of the destination, when the destination is larger than the source (during in-place update). This is necessary to maintain correctness of scan iteration, so that the zero-ed out regions are correctly skipped.
- 2c699a3 [C#] Added methods to SpanByte
- 897d6a8 [C#] Benchmark corner case fixes
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at:
- https://www.nuget.org/packages/Microsoft.FASTER.Core
- https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
More information at:
Changes:
- a0209aa [C#] SpanByte - a safe wrapper for variable-length keys and values (#349)
- f6fb68f [C#] Support variable length Input (#351)
- eaaed8e [C#] Benchmark settings to backup & restore database for quicker runs (#350)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at:
- https://www.nuget.org/packages/Microsoft.FASTER.Core
- https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
More information at:
Changes:
- f2b3483 [C#] Added NeedCopyUpdate to IFunctions for RMW (#345)
- 031aece Fix async object retrieval when tombstones set on objects
- 18cf54d [C#] Adding ref-free overloads to FASTER operations (#346)
- 5c4c45e remove dead code
- 962b401 [C#] Dispose ClientSessions from FasterKV. Also: (#342)
- e9dd339 [C#] Fix StackOverflow during CompleteCheckpointAsync (#343)
- f7d3594 Fixed task completion source to run continuations asynchronously. (#340)
- 7fa7434 [C#] Async version of RMW that returns status (#339)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at:
- https://www.nuget.org/packages/Microsoft.FASTER.Core
- https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
More information at:
Changes:
- f35a709 [C#] Sample to show read-only secondary reader store constantly catching up to primary store (#334)
- ffa3caa [C#] Support FasterLog scan from different process (#333)
- 12aa82f [C#] Recovery improvements (#330)
- e61e9be [C++] Fix a deadlock condition (#331)
- 0fc5689 [C#] Allow recovery without index checkpoint (#328)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at:
- https://www.nuget.org/packages/Microsoft.FASTER.Core
- https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
More information at:
Changes:
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at:
- https://www.nuget.org/packages/Microsoft.FASTER.Core
- https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
More information at:
Changes:
- 7dd5ba8 updated csproj for Release to remove DebugType
- a0a62a6 [C#] More sample cleanup + mark old API obsolete (#325)
- e3f3379 limit preloaded pages during recovery (#292)
- bf7af17 Updated nuspec
- c5d1f52 [C#] CPR function callback race condition. (#323)
- 00975b1 [C#] [WIP] Updated and reorganized samples + docs (#312) [ #313, #314 ]
- 8ecdb35 [C#] Fixing issue with frequent CPR during RMW workload (#322)
- bb71fb6 fix to sample
- 82413fe Compaction fixes
- 5153855 Change back Serialize API from "in" to "ref" to avoid defensive copy of structs. (#318)
See More
- 797de0f Update FASTER.devices.AzureStorageDevice.nuspec
- 007987c Update FASTER.core.nuspec
- 28ba814 Update README.md
- 09b40e3 Update README.md
- 5de0579 [C#] Moving to new NuGet versioning system (#319) [ #315 ]
- 0974c9f [C#] Add documentation of publish-subscribe with uncommitted entries (#317)
- d490b5c Fixes issue on Linux devices, where parallel reads on same fine handle are unsupported. We already sequentialize for Writes, this bugfix applies this to Reads as well. (#315)
- 78ffc9d [C#] Improvements to API (#310)
- 0617852 [C#] Guard against info being reset by global state machine (during checkpointing) (#311)
- a0880d7 [C#] Remove generic type constraint + add DataContract serializer (#305)
- f8ee532 [C#] Checkpoint and benchmark improvements + tests (#299)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at:
- https://www.nuget.org/packages/Microsoft.FASTER.Core
- https://www.nuget.org/packages/Microsoft.FASTER.Devices.AzureStorage
More information at:
Changes:
- 4ea67f2 Update nuspec to use new package name and versioning.
- 882724b fix directory creation in ManagedLocalStorageDevice
- 027151d Fixes issue on Linux devices, where parallel reads on same fine handle are unsupported. We already sequentialize for Writes, this bugfix applies this to Reads as well. (#315)
- eb737b1 Merge branch 'master' of https://github.com/microsoft/FASTER
- 06de330 Fixing testcase
- fa0c521 Update FasterLog.md
- 7743f54 Update FasterLog.md
- a995ef5 Update FasterLog.md
- 703fd49 Update FasterLog.md
- 5dc06d0 Update FasterLog.md
See More
- 7bb7f60 Add files via upload
- 0d48146 Update FasterLog.md
- 16ad5ba Fix InternalContinueRmw did not check tombstone (#300)
- 123ba11 [C#] [WIP] FasterLog support for scanning uncommitted data (#298)
- 5236cc3 [C#] IDevice v2 (#297)
- 8e094cd [C#] FASTER Generic IDevice log/commit manager+ AzureStorageDevice improvements (#288)
- f7d7550 Fix to checkpoint large hash tables (> uint.MaxValue) correctly. (#294)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- 6c5e7db Separate out Input-dependent functions by session, for variable length structs (#290)
- 8f69167 [C#] [WIP] Iterator for all distinct keys in FASTER KV (#287)
- b3c8273 Update azure-pipelines.yml
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- cf0f199 Allow checkpoint type to be chosen per instantiation (#285)
- dc38f04 Re-enable tests on Linux (#286)
- 07f8929 Fix CPR state machine issues when a new thread affinitized sessions starts during an active checkpoint. (#280)
- 1e72025 Update CMakeLists.txt
- 9b96efc Functions in session (#270) [ #230, #272 ]
- 9c6bd1a Make sure we have at least kHeaderSize immutable pages in log (#284)
- 88d7282 New API for clean handling of VariantLengthKey (#282)
- 46de893 [C++] Update to use with VS 2019, benchmark default to non-checkpointing (#283)
- 51fdd31 Update README.md
- b34918e Update README.md
See More
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- ffc2c30 Prepopulate log file handles (#274)
- 3fc5429 Fast-forward client session trivially to the current system state, if the current system state were not associated with any state machine (null currentSyncStateMachine implies a trivial state machine). This can happen after recovery. (#273)
- b073aa7 Add ReadyToCompletePendingAsync for client to check if there is somet… (#269)
- 352db06 Update other README.md docs with correct NuGet download link. (#267)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- d8aaee5 Fixing deletes to handle CPR operation status.
- 0de60be Improve Code Quality (#264)
- 058cdf5 Update FASTER.core.debug.nuspec
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- 1845ba2 Cross target .NETSTANDARD2.1 and update playground examples to .NETCOREAPP3.1 (#262)
- c6c4420 Skip WAIT_PENDING check if using relaxed CPR (#261)
- 54b92c9 Fix latching logic to work uniformly for normal and relaxed CPR. (#260)
- a0ec4aa State Machine Improvement (#258)
- c98de54 Compaction for C++ FASTER (#250)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- 7122495 Speed up async read (#256)
- 26569b2 Issue 246 continuations wiring (II) (#248)
- 9da270e Added overload of GetNext() that also returns next address (#251)
- bd5ad88 Ref keys on async methods (#242)
- 8f14cf4 User should be able to provide context class when using async methods (#240)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- 8f9cf2c change gtest print support functions to inline faster.h defn (#237)
- b2c3863 Fix GetNext to return address of currently returned record, not the next address.
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- 7516096 Cleaned up sample contribution
- 1ab9434 Faster test (#233)
- 1c1c659 Collect object log offsets (as part of recovery info) only after flushes are complete.
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- 0615c73 Improved testcase to cover object logs with non-zero segment offset, added correctness checking for all keys during read.
- 522716a Merge branch 'master' of https://github.com/microsoft/FASTER
- 6605c8a Merge branch 'iter-fixes' of https://github.com/microsoft/FASTER into iter-fixes
- 796a837 Make sure object log segment offets are written out to the recovery info in RelaxedCPR mode.
- de06b2c Merge branch 'master' into iter-fixes
- 518a133 Use requestedCompletedUntilAddress correctly.
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- 3988acd Fix complete-pending & segment sizes for object log (#228)
- b8f3c3b Update typo in README (#223)
- 7432761 FasterLog iterator fixes. (#222)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- e616292 merge
- 0e6e654 Updated nuspec
- edc6152 Update README.md
- 3a66c7f Update README.md
- a8e1f3c Support async/await session model (#130)
- 49866bf fixed call to newsession
- ecbf696 Minor fixes.
- b31631b Merge branch 'async-support' of https://github.com/microsoft/FASTER into async-support
- 0624fd5 Updates based on review.
- 95c0e58 Merge branch 'master' into async-support
See More
- 2987b6e Change link to Microsoft.FASTER (#219)
- a16c5eb Update README.md
- 255c000 Added tests
- 0237a0c Added async API to sessions, added first draft of async sample.
- 1eca340 Major API cleanup and porting to session-based interface
- b3cccd0 Fix merge
- 876c0d3 Merging from master
- 47d50d1 Fix to snapshot checkpoint with object log, where snapshot objects en… (#218)
- 193e180 Updated couple places with FasterException instead of Exception
- d96a164 reset ownership if handle creation fails (#213)
- 312a778 FASTER now throws exceptions of type FasterException instead of Exception. (#217)
- 6b03887 Merge branch 'master' into async-support
- e3bd096 Add print support for several class to adapt gtest update. (#214)
- a1b87a5 Merge branch 'master' into async-support
- a90aa54 Update CMakeLists.txt.in
- 711f0bf Update FasterLog.md
- 6e7f6c7 Merge branch 'master' of https://github.com/microsoft/FASTER
- bf65763 Updated IAsyncEnumerable to also return entry address
- 32417f6 Update FasterLog.md
- db9bf45 Update FasterLog.md
- 237c227 Update FasterLog.md
- 72ecc4f Fixed break
- 0f65fbb Merge branch 'master' into async-support
- ca15128 Merge branch 'master' into async-support
- c4fba23 Merge branch 'master' into async-support
- fc47dbd Merging goodness from master.
- e0f745f Merging from fasterlog
- 5caea66 Improved sample, changed GetMemory to use byte[] instead of Span
- db68ae0 Added a test
- c55de3f Actually checking in support for 1 page in memory, added initial draft of disposing task
- 089d545 Cleanup and updates.
- 915f01e Merge branch 'fasterlog' into async-support
- 8e42a74 Support minimum buffer size of just 1 page!
- 7565a21 Merging
- 0c0bf58 Updates to merge
- 72cdfdb Merging from FasterLog branch for epoch and allocator goodness.
- ff27448 Update azure-pipelines.yml
- 6dc7af6 Updated way to pin pooled memory
- 127e908 Updates
- 0050694 Added MemoryPool/IMemoryOwner variant of iterator
- 80a2aeb Convert Span to ReadOnlySpan for appends
- 540d1a5 Merge branch 'fasterlog' of https://github.com/Microsoft/FASTER into fasterlog
- 944504b Added tailing iterator WaitAsync to wait for iteration to proceed.
- 002b993 Merge branch 'master' into fasterlog
- b06d112 Fasterlog async (#180)
- 4504937 merge
- bb4e357 minor fix
- ec2a3b5 Fasterlog TryAppend (#179)
- 2cd85e3 Fasterlog lowmem (#178)
- ddcc338 Added TryAppend so users can implement log throttling.
- 88d7269 Added commit and recovery support.
- ce31917 Fixing break after merge.
- 4ef03bb Merge branch 'fasterlog' into async-support
- 19d5d82 Fixing test change
- 6315a14 Cleaned up epochs, improved fine grain scalability.
- 853b3ea Updates
- 3077f52 Updates.
- 16edd83 Initial checkin
- 29c64e1 Merge branch 'master' into async-support-test
- 669881d Cleanup of warnings
- 0740f87 Merge branch 'async-support' into async-support-test
- 38a26ff Added tests
- e170463 updates
- 78c2649 Updates to support sessions natively without thread-local
- b9404b6 Fixing merge
- 990d789 Merging from work branch
- 6cab32a Fixing thread local init, cleanup
- 62cecc8 Cleaning up interface and comments.
- 9afc5fb Wired in excluded serial nos for commit points.
- 94b901e Merge branch 'master' into async-support-test
- 27b677e Fixes
- 00fadc5 Merge branch 'master' into async-support-test
- d03bcea Updates
- b2479ed Merge branch 'async-support-test' of https://github.com/Microsoft/FASTER into async-support-test
- b16212f Updates
- 75b9cb2 Update
- 81a4a82 Merging from master
- 7e80b07 Merge branch 'master' into async-support
- 68df34d trying to reduce async context - incomplete
- 5cda2f9 more tests, phew
- 4dc6d27 Update azure-pipelines.yml
- 1c33b49 Update azure-pipelines.yml
- e925af3 Update azure-pipelines.yml for Azure Pipelines
- 03c4d8e Update azure-pipelines.yml for Azure Pipelines
- 026912c test
- 4b75494 test
- 572b8bd revert max threads in pool
- 789d38e update
- 363508c Merge remote-tracking branch 'origin/async-support-test2' into async-support-test
- ea64fdf Revert "Update"
- d7064e8 Updated fast threadlocal
- 9c60144 Update
- 9e84d63 Removing sample test code.
- 30adeca Updates and bugfixes
- 733e4de update
- 26be7f6 update
- 82a01a5 Update
- e5a4859 Merge branch 'async-support' of https://github.com/Microsoft/FASTER into async-support
- 869a88e Merge branch 'master' into async-support
- d72c92a Correct handling of thread switching with async
- a486834 Update testcase
- 1754b68 Persist dormant sessions correctly.
- dbe13fd Improved async sessions interface, working now. Does not persist domant sessions yet. See SimpleRecoveryTest3 for sample.
- 0bd752e Support true async CompleteCheckpoint
- 2eafe9b Support suspend/resume sessions
- bcb75e7 Update azure-pipelines.yml
- c67d882 Update azure-pipelines.yml
- 2a2d7ac Update azure-pipelines.yml
- 252ef54 Update azure-pipelines.yml
- c41855e Update azure-pipelines.yml
- d63603c Merge branch 'async-support' of https://github.com/Microsoft/FASTER into async-support
- 571333d Initial checkin of async CompletePending - no tests yet.
- 7a487e3 Update FASTER.core.csproj
- 0353678 Support large number of sessions (not limited by epoch table size). Sessions load their context into the thread-local context on every operation. Currently, we do not suspend sessions automatically after each operation.
- 366a8cc Merge branch 'async-support' of https://github.com/Microsoft/FASTER into async-support
- 4412113 Merge branch 'master' of https://github.com/Microsoft/FASTER into async-support
- 6c5420a Merge branch 'master' into async-support
- 2fff5cb Merge branch 'master' into async-support
- 533652b Updates to session support
- 00dc474 Improved support, added session pooling option, added session testcases.
- 2b7e24f Rough sketch of session without touching currrent thread-local framework: session-based acccess just updates existing thread-local variables to set the session for the current thread.
- 3d17a2d Merge branch 'master' into async-support
- 0c7bddd Merge branch 'master' into async-support
- 63d1276 Merge branch 'master' into async-support
- fc89978 Merge branch 'master' into async-support
- 484c674 Initial checkin
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/Microsoft.FASTER. More information at:
Changes:
- ff51d3c Managedlocalstorage fixes (#209)
- 98889ae [FasterLog] Concurrent iteration (#198)
- adefb0e Ensure pending drain actions are processed when all tasks have exited epochs (#205)
- 809d1f1 [C++] Harden concurrent in_memory_test tests (#202)
- a01172f [CI] Run C++ tests on Linux (#200)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/FASTER. More information at:
Changes:
- 4d90dac Exposing FASTER log as a first-class abstraction (#177) [ #178, #179, #180, #189 ]
- 43004fa [C++][tests] Extract common (simple) key and value definitions for reuse (#186)
- f3c3eb0 Allow users to pre-allocate HybridLog (#175)
- 5faf2b7 cc: support growing values in InternalContinuePendingRmw (#174)
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/FASTER. More information at:
Changes:
- 578e925 Merge branch 'master' of https://github.com/microsoft/FASTER
- 0233178 Fixing monotonic update
- d38103c Fixing error with pages completing flush after allocator is disposed.
- b26523c Updates to clean up & fix recent PR
This list of changes was auto generated.
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/FASTER. More information at:
Changes:
- 4d94966 Implemented iterator for variable length structs. (#164)
- d1418f6 Update Roadmap.md
- 73e325e Sharded storage device (#162)
- 61698c5 Tiered storage device (#151)
- 25f72ff Update Roadmap.md
- 85daf80 Update Roadmap.md
- 84e7595 Fix recovery logic to correctly read back page and include begin address in recovery info. (#168)
- 667434e Update FASTER.core.debug.nuspec
- d4b551e Update FASTER.devices.AzureStorageDevice.nuspec
- 315dd6a Update FASTER.devices.AzureStorageDevice.nuspec
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at https://www.nuget.org/packages/FASTER. More information at:
Changes:
- 132c2b1 Updated nuspec
- 84c60b4 Updated nuspec
- 0519715 Page blob device (#147)
- f28f8a9 Update Roadmap.md
- 65872b0 Update Roadmap.md
This list of changes was auto generated.
| Watchers：181 |
| Star：4262 |
| Fork：339 |
| 创建时间： 2018-08-02 14:38:41 |
| 最后Commits： 5天前 |
| 许可协议：MIT |
075a10aCompare
Verified
Visit https://microsoft.github.io/FASTER/roadmap for release features and project roadmap. Get NuGet binaries at:
More information at:
Changes:
This list of changes was auto generated.