How to configure Ubuntu amd64 18.04 LTS or amd64 18.10 to automatically read/write a single file in parallel?
The memory page size of amd64 linux is often 4096 bytes (4KB) and cannot be changed. Nor should it be changed.
Is it possible to install and configure Ubuntu 18.04 amd64 LTS or amd64 18.10 on a xfs/btrfs filesystem with a 4096 byte (4 KB) block size such that:
If you read/write a 32 KB file and your CPU processor has 8 threads available across 4 cores, your CPU will use each thread to read/write a 4KB block from/to the file in parallel? Is this already how Ubuntu works?
Specifically, I mean that if your hypothetical default Ubuntu version uses one thread to read/write 4KB blocks one by one in order from/to a file at a hypothetical rate of a single 4KB block per millisecond (thus reading/writing the 32KB file in 8 milliseconds), is it possible to configure that Ubuntu version to always use all freely available threads to read/write multiple 4KB blocks simultaneously (in parallel) and finish reading/writing the 32 KB file in 4 milliseconds with two threads, 2 milliseconds with four threads, or 1 millisecond with 8 threads available?
Can this be done with Ubuntu 18.04 amd64 LTS or Ubuntu 18.10 amd64? Again, is this already the default behavior?
I do not want to change the default block size because it only makes some workloads faster while making other workloads slower and might possibly slow down my entire filesystem worst case.
18.04 64-bit performance 18.10
asked 8 mins ago
KyakacooKyakacoo
32
add a comment |
The memory page size of amd64 linux is often 4096 bytes (4KB) and cannot be changed. Nor should it be changed.
Is it possible to install and configure Ubuntu 18.04 amd64 LTS or amd64 18.10 on a xfs/btrfs filesystem with a 4096 byte (4 KB) block size such that:
If you read/write a 32 KB file and your CPU processor has 8 threads available across 4 cores, your CPU will use each thread to read/write a 4KB block from/to the file in parallel? Is this already how Ubuntu works?
Specifically, I mean that if your hypothetical default Ubuntu version uses one thread to read/write 4KB blocks one by one in order from/to a file at a hypothetical rate of a single 4KB block per millisecond (thus reading/writing the 32KB file in 8 milliseconds), is it possible to configure that Ubuntu version to always use all freely available threads to read/write multiple 4KB blocks simultaneously (in parallel) and finish reading/writing the 32 KB file in 4 milliseconds with two threads, 2 milliseconds with four threads, or 1 millisecond with 8 threads available?
Can this be done with Ubuntu 18.04 amd64 LTS or Ubuntu 18.10 amd64? Again, is this already the default behavior?
I do not want to change the default block size because it only makes some workloads faster while making other workloads slower and might possibly slow down my entire filesystem worst case.
18.04 64-bit performance 18.10
asked 8 mins ago
KyakacooKyakacoo
32
add a comment |
The memory page size of amd64 linux is often 4096 bytes (4KB) and cannot be changed. Nor should it be changed.
Is it possible to install and configure Ubuntu 18.04 amd64 LTS or amd64 18.10 on a xfs/btrfs filesystem with a 4096 byte (4 KB) block size such that:
If you read/write a 32 KB file and your CPU processor has 8 threads available across 4 cores, your CPU will use each thread to read/write a 4KB block from/to the file in parallel? Is this already how Ubuntu works?
Specifically, I mean that if your hypothetical default Ubuntu version uses one thread to read/write 4KB blocks one by one in order from/to a file at a hypothetical rate of a single 4KB block per millisecond (thus reading/writing the 32KB file in 8 milliseconds), is it possible to configure that Ubuntu version to always use all freely available threads to read/write multiple 4KB blocks simultaneously (in parallel) and finish reading/writing the 32 KB file in 4 milliseconds with two threads, 2 milliseconds with four threads, or 1 millisecond with 8 threads available?
Can this be done with Ubuntu 18.04 amd64 LTS or Ubuntu 18.10 amd64? Again, is this already the default behavior?
I do not want to change the default block size because it only makes some workloads faster while making other workloads slower and might possibly slow down my entire filesystem worst case.
18.04 64-bit performance 18.10
asked 8 mins ago
KyakacooKyakacoo
32
The memory page size of amd64 linux is often 4096 bytes (4KB) and cannot be changed. Nor should it be changed.
Is it possible to install and configure Ubuntu 18.04 amd64 LTS or amd64 18.10 on a xfs/btrfs filesystem with a 4096 byte (4 KB) block size such that:
If you read/write a 32 KB file and your CPU processor has 8 threads available across 4 cores, your CPU will use each thread to read/write a 4KB block from/to the file in parallel? Is this already how Ubuntu works?
Specifically, I mean that if your hypothetical default Ubuntu version uses one thread to read/write 4KB blocks one by one in order from/to a file at a hypothetical rate of a single 4KB block per millisecond (thus reading/writing the 32KB file in 8 milliseconds), is it possible to configure that Ubuntu version to always use all freely available threads to read/write multiple 4KB blocks simultaneously (in parallel) and finish reading/writing the 32 KB file in 4 milliseconds with two threads, 2 milliseconds with four threads, or 1 millisecond with 8 threads available?
Can this be done with Ubuntu 18.04 amd64 LTS or Ubuntu 18.10 amd64? Again, is this already the default behavior?
I do not want to change the default block size because it only makes some workloads faster while making other workloads slower and might possibly slow down my entire filesystem worst case.
18.04 64-bit performance 18.10
18.04 64-bit performance 18.10
asked 8 mins ago
KyakacooKyakacoo
32
asked 8 mins ago
KyakacooKyakacoo
32
asked 8 mins ago
KyakacooKyakacoo
32
asked 8 mins ago
KyakacooKyakacoo
32
asked 8 mins ago
KyakacooKyakacoo
32
32
add a comment |
add a comment |
0
active
oldest
votes
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "89"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2faskubuntu.com%2fquestions%2f1130523%2fhow-to-configure-ubuntu-amd64-18-04-lts-or-amd64-18-10-to-automatically-read-wri%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Ask Ubuntu!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2faskubuntu.com%2fquestions%2f1130523%2fhow-to-configure-ubuntu-amd64-18-04-lts-or-amd64-18-10-to-automatically-read-wri%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
