Commit Graph
18431 Commits
Author SHA1 Message Date
vichansson e008ef40bf M #-: Clear ramdisk on kernel path clear (#3273)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit 2fe102032e)
2024-10-22 10:08:02 +02:00
vichansson 4a5c6aa989 M #-: Clear ramdisk selection properly (#3272)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit dac6d9dca3)
2024-10-21 16:03:35 +02:00
vichansson 69dafc8b2a L OpenNebula/one#6751: Lint fix (#3270)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
2024-10-21 11:17:46 +02:00
vichansson d8fcdbb046 B OpenNebula/one#6751: Fix raw data validation handling (#3269)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
Co-authored-by: Tino Vázquez <cvazquez@opennebula.io>
(cherry picked from commit 5333608e42)
2024-10-21 11:00:27 +02:00
Daniel Clavijo Coca 383bd5300a B OpenNebula/one#6758: Fix QEMU_GA ping monitoring
(cherry picked from commit f698097708)
2024-10-18 18:49:50 +02:00
vichansson c4746824d8 M #-: Fix apiResponse data handling (#3268)
- If the API response returns only 1 object, it won't be array wrapped,
  causing issues when formatting the response to a dataset. Now
  transformApiResponseToDataset always casts the response to an array.

Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit 51ef95d720)
2024-10-18 14:43:37 +02:00
vichansson 1f003cbcd5 B OpenNebula/one#6744: Fix placement expression formatting (#3258)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit 60bfce4146)
2024-10-14 17:16:01 +02:00
Guillermo Ramos d486ee1ae4 F #-: Fix Ceph VM restore ignoring EC_POOL_NAME
Signed-off-by: Guillermo Ramos <gramos@opennebula.io>
(cherry picked from commit ad24f28616)
2024-10-11 15:39:42 +02:00
Guillermo Ramos 25a094155e F #-: Fix use of --data-pool flag in Ceph's DS.cp
Signed-off-by: Guillermo Ramos <gramos@opennebula.io>
(cherry picked from commit 788534b9b9)
2024-10-11 15:39:38 +02:00
Anton Todorov 9f92eabab1 B #6689: append --block to change-media call in reconfigure
when the $ISO_PATH is a block device

(cherry picked from commit bf43d43bec)
(cherry picked from commit d5b5a4d5a4)
2024-10-11 10:09:57 +02:00
vichansson 0f8d43a4be L #-: Lint fix (#3263)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit c6d9a45ec5)
2024-10-10 16:17:24 +02:00
vichansson b0ba87bac1 B OpenNebula/one#6746: Always display DS limit if set (#3259)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
Co-authored-by: Tino Vázquez <cvazquez@opennebula.io>
(cherry picked from commit b379fb95f8)
2024-10-10 14:38:25 +02:00
vichansson 5b1f99a7bb F OpenNebula/one#6742: Update OS & CPU tab layout (#3262)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit 32805d4130)
2024-10-10 14:37:40 +02:00
vichansson f15665995d B OpenNebula/one#6744: Fix host requirements expression (#3257)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit c4d727c79c)
2024-10-09 11:02:28 +02:00
Michal Opala 527d1edb78 B #-: Add tproxy fixes: socket leak + nft formatting (#3256)
- Ensure sockets are always closed properly.
- Normalize and cleanup nft scripts (to prevent potential segfaults).

(cherry picked from commit 8537add365)
2024-10-09 10:26:28 +02:00
Guillermo Ramos a47839f1fa Optimize snapshots usage in RBD incr. restore
- Incremental backups only keep the last snapshot, to be used as base in
  the next one.
- Restore operation deletes the previous snapshots, because at that
  point the chain is reset and they're no longer going to be used.
- Starting a new FULL backup also deletes previous inc snapshots.
- Refactor the remote execution logic to make it more composable.

Signed-off-by: Guillermo Ramos <gramos@opennebula.io>
(cherry picked from commit 1790b5f3f9ac55e3149f5344580330c27d5585df)
(cherry picked from commit 7ddf9b3b72)
2024-10-08 15:37:04 +02:00
vichansson 9139503e59 B OpenNebula/one#6746: Fix DS LIMIT_MB parsing (#3254)
Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit 8c8f053c39)
2024-10-08 10:02:33 +02:00
Ruben S. Montero 7f67cc681a F #6411 + B #6741: Incremental backups for Ceph datastore
Implementation overview:

- Incremental points are saved as dedicated rbd snapshots under the
  "one_backup_<increment_id>" namespace. This snapshots are used to
  generate delta files in rbdiff format.

- The rbdiff formats are stored in the backup server to restore the rbd volumes.

- The restore process is performed directly on the Ceph cluster
  importing the base image (first full backup in the chain, rbd import)
  and then applying the increments (rbd import-diff) up to the target
  increment.

- Two new pseudo-protocols has been implemented to adopt the restore
  pattern above (restic+rbd, rsync+rbd). This protocols bundle of the
  rbdiff files in a tarball for transfer from the backup server. Note:
  reconstruct process uses the Ceph BRIDGE_LIST and not the backup
  server (as opposed to qcow2 backups)

Other bug fixes

- This commit also fixes #6741, resetting the backup chain after a
  restore

- The original ceph drivers do not receive the full action information,
  this now has been fixed by including VM information in the STDIN string sent
  to the driver.

Compatibility note.

- backup actions should return now the backup format used raw, rbd, ...
  If not provided oned (6.10.x) will use raw as a default to accommodate any
  third party driver implementation. It is recommended to include this
  third argument.

Signed-off-by: Guillermo Ramos <gramos@opennebula.io>
Co-authored-by: Guillermo Ramos <gramos@opennebula.io>
(cherry picked from commit 5f7b370c52)
2024-10-04 20:29:22 +02:00
Pavel Czerný d570f6bdf3 F #2111: Optimize VM history handling (#3243)
- oned load only last 2 history records (not the full list)
- Dump all history records only if needed in VirtualMachine::to_xml.
- Dump conforms XML schecam and removes VM template from history records.

Speed up of onevm show command:
  - for small SQLite DB is for VM with 500 histories: 130 ms down to 5 ms
  - for big MySQL DB VM with 687 histories: 1000 ms down to 200 ms

(cherry picked from commit e13c329db4)
2024-09-30 15:49:46 +02:00
Michal Opala ba8c46e8b0 B #-: Do not use ERB with trim mode (alma8 fix) (#3250)
(cherry picked from commit 0c6620c9a9)
2024-09-27 15:56:44 +02:00
Jorge Miguel Lobo Escalona fd9daa2b26 M #~: horizontally align the ssh console (#3249)
(cherry picked from commit 2345ff87a2)
2024-09-27 15:10:28 +02:00
vichansson 3d337d9ff5 B OpenNebula/one#6739: Fix VM restore disk selection (#3248)
* Correctly displays the VM disks when restoring a backup from the VM
  action menu

Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit 8f0d20580e)
2024-09-27 13:20:05 +02:00
Michal Opala 93459a9497 F OpenNebula/one#6641: Add the "string-phone" transparent proxy (#3221)
This feature let's cloud admin to proxy VM connections to any service through the hypervisor. VMs uses a link local IP that is forwarded to a local proxy. This simplifies VM network requirements, e.g. to access gateway, vaults, configuration services etc...

Implementation:
- Use network namespaces to isolate VNET networking. ip netns command is executed through a wrapper to limit sudo access to commands.
- Add tproxy.rb app to manage a group of daemons on HV nodes.
- Use unix sockets for communication between proxy peers. "Inner" proxy runs in the netns without any network access. "Outer" proxy handles HV connections to services.
- Use OpenNebulaNetwork.conf + 'onehost sync -f' for configuration. Proxy can be defined per network.

NOTE: This commits does not include modifications to OpenNebulaNetwork.conf

(cherry picked from commit b1ef4332e5)
2024-09-26 18:36:54 +02:00
Jorge Miguel Lobo Escalona 6db0940e2d F #6718: add data-cy for tests (#3245) 2024-09-25 18:29:46 +02:00
David efa5e62be2 M #-: Protect the labels column to check that is always a string (#3244)
Signed-off-by: dcarracedo <dcarracedo@opennebula.io>
(cherry picked from commit 1fcb2ba576)
2024-09-25 10:11:53 +02:00
vichansson 8950a11518 F OpenNebula/one#6703: VM's table display hostname (#3242)
* Now displays hostname next to the host in the card view
* Also displays hostname in the list view

Signed-off-by: Victor Hansson <vhansson@opennebula.io>
2024-09-24 10:21:40 +02:00
Pavel Czerný 48506a7e0e M #-: onedb fsck check history seqence id (#3237)
* It looks like `onedb purge-history` sometimes fails to delete some history records.
* Delete all history records with SEQ greater then VM/HISTORY_RECORDS/HISTORY/SEQ, which should be the last record

(cherry picked from commit a3c4776468)
2024-09-24 09:27:44 +02:00
Pavel Czerný 21dbf2a81f B OpenNebula/one#6596: Fix Host NUMA nodes after VM migration (#3226)
* Fix Host NUMA nodes after VM migration
* Move template parsing to HostShareCapacity

+ add warning about unsafe pointer usage

(cherry picked from commit 0cde7d96a2)
2024-09-24 09:12:46 +02:00
Jorge Miguel Lobo Escalona c788e5bc5f F OpenNebula/One#6718: lint-fix (#3240) 2024-09-23 19:20:47 +02:00
Jorge Miguel Lobo Escalona 80dc9b4b05 F OpenNebula/one#6718: add labels in rows (#3238) (#3239) 2024-09-23 19:13:04 +02:00
Ruben S. Montero 6893305782 M #-: OpenNebula vm exporter wrong unit for total mem
Metric is in bytes, MB was published
2024-09-23 12:04:12 +02:00
Jorge Miguel Lobo Escalona 03ad300fb8 F OpenNebula/One#6718: Fix error timeout (#3236)
using the finder in tables

(cherry picked from commit f01175bca8)
2024-09-23 11:30:02 +02:00
Guillemo Ramos ce28e10730 B #6505: Fix volatile disk backup (Ceph) (#3225)
* B #6505: follow-up fix for Ceph bk/restore (#3212)

Signed-off-by: Guillermo Ramos <gramos@opennebula.io>
Co-authored-by: Pavel Czerný <pczerny@opennebula.io>
(cherry picked from commit c8d28ad18f)
2024-09-20 12:05:17 +02:00
Jorge Miguel Lobo Escalona 4afac0039c F OpenNebula/One#6718: Add DataTable rows as lists functionality 2024-09-19 12:50:38 +02:00
David cd4bcba0b9 B OpenNebula/one#6725: Fix problems in vrouters in Sunstone (#3230)
Signed-off-by: dcarracedo <dcarracedo@opennebula.io>
Co-authored-by: Tino Vázquez <cvazquez@opennebula.io>
(cherry picked from commit b2fe5a3010)
2024-09-18 13:50:01 +02:00
ArnauGabrielAtienza e705cb7e32 F OpenNebula/one#6624: Fix no snapshots available bug (#3229)
Signed-off-by: ArnauGabrielAtienza <agabriel@opennebula.io>
(cherry picked from commit a95a94b5a6)
2024-09-16 17:36:52 +02:00
ArnauGabrielAtienza c8dbd9ae79 F OpenNebula/one#6624: Add list list-disk-snapshots (#3228)
in onevm for a specific disk

Signed-off-by: ArnauGabrielAtienza <agabriel@opennebula.io>
(cherry picked from commit 263cba6749)
2024-09-16 11:15:24 +02:00
Jorge Miguel Lobo Escalona 158b000669 F OpenNebula/one#6708: Fixed review of support tab in fireedge (#3227)
(cherry picked from commit a00ac1822c)
2024-09-12 19:00:27 +02:00
Jorge Miguel Lobo Escalona 15b90ca352 F #6717: remove text (EE only) Store Restic (#3224)
(cherry picked from commit 3858747958)
2024-09-11 19:17:30 +02:00
vichansson 8e3ec6fcee B OpenNebula/one#6716: Correct instances amount when instantiate (#3223)
* Now instantiates the correct number of instances specified for a
  service ServiceTemplate
* Default number of instances set to 1

Signed-off-by: Victor Hansson <vhansson@opennebula.io>
(cherry picked from commit 212aa91a3c)
2024-09-10 16:45:21 +02:00
Jan Orel 1e3757d845 F #6577: Replace aenum by enum (#3220)
(cherry picked from commit 148e488832)
2024-09-10 13:22:09 +02:00
Pavel Czerný 027b03f38a B OpenNebula/one#6701: Fix total_mb in s3/monitor (#3218)
* Fixes 02e0fcedfd

(cherry picked from commit be6bcf877d)
2024-09-09 14:02:13 +02:00
Pavel Czerný ab0badcb1c B #6532: Sunstone fix backup volatile disk checkmark (#3216)
(cherry picked from commit b2ab5b7c9c)
2024-09-05 16:38:45 +02:00
Pavel Czerný c546ed5240 B #6687: Fix monitoring initialization and restart
* Cleanup oned in case of initialization error

* Fix monitoring after onemonitord restart. The code includes a "hook" point in case a driver is re-started so custom code can be executed. InformationManager sends the list of hosts and raft status in this case.

* B #5801: Update error msg, in case of duplicated drivers

(cherry picked from commit 7b07def90e)
2024-09-05 16:25:28 +02:00
Shanobi a40c048f9d M #-: Fix spelling in onevm command help
(cherry picked from commit 822581a032)
2024-09-05 15:58:05 +02:00
marchenkov.s 8c745a9596 B #6692: Check VMGroupRole in Inter-role Anti-affinity rules
Add a check before dereferencing the group roles pointer.

(cherry picked from commit 48bab98a25)
(cherry picked from commit 1607b4a014)
2024-09-05 15:58:05 +02:00
David 9ce5fc5fd8 B OpenNebula/one#6707: Boolean default values on user inputs (#3215)
Signed-off-by: dcarracedo <dcarracedo@opennebula.io>
(cherry picked from commit 4a1abef990)
2024-09-05 11:34:49 +02:00
Pavel Czerný af05a4c991 F #6524: Check free space on backup DS (#3214)
(cherry picked from commit ccc8ccfc34)
2024-09-04 13:27:58 +02:00
Pavel Czerný 82630a617b B #6505: Fix volatile disk backup (#3212)
* F #6505: Fix volatile disk backup and restore

* F #6578: Skip backup of CDROM

(cherry picked from commit c8c66b1d8f)
2024-09-04 13:16:52 +02:00
Pavel Czerný be752c3e96 B #6607: Fix size of restored disk from backup (#3210)
(cherry picked from commit 420162da67)
2024-09-04 12:58:30 +02:00